2024-09-11T08:00:25.897 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T08:00:25.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T08:00:25.999 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261 branch: wip-guits-quincy-2024-09-10-2008-quincy description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} email: gabrioux@ibm.com first_in_suite: false job_id: '7901261' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-quincy-2024-09-10-2008-quincy ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-guits-quincy-2024-09-10-2008-quincy sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 2282 sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-quincy-2024-09-10-2008-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d0e6828a2016d48cf25ad84064e50742bb1c39b9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 targets: smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAn11JuIdBtxPhstDZGZXWVrrnvDnlcGtIGZcLzq1bsJ8JGjJZgf5Hke5oj9O59jjdlvtScpPm1u1J9daawyw+A= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJz9HoUDgngTXRhlVwX9AVsHbTVNpW03xqxYJNp4oWbmg4z0sB47S2wbScPHyCnOsjeRfNNgV0MPeMtjoJ4Z8Y= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_06:53:43 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T08:00:25.999 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d0e6828a2016d48cf25ad84064e50742bb1c39b9/qa; will attempt to use it 2024-09-11T08:00:26.000 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d0e6828a2016d48cf25ad84064e50742bb1c39b9/qa/tasks 2024-09-11T08:00:26.000 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T08:00:26.001 INFO:teuthology.task.internal:Checking packages... 2024-09-11T08:00:26.022 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd0e6828a2016d48cf25ad84064e50742bb1c39b9' 2024-09-11T08:00:26.022 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T08:00:26.022 INFO:teuthology.packaging:ref: None 2024-09-11T08:00:26.022 INFO:teuthology.packaging:tag: None 2024-09-11T08:00:26.022 INFO:teuthology.packaging:branch: wip-guits-quincy-2024-09-10-2008-quincy 2024-09-11T08:00:26.022 INFO:teuthology.packaging:sha1: d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:00:26.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-quincy-2024-09-10-2008-quincy 2024-09-11T08:00:26.161 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1623.gd0e6828a 2024-09-11T08:00:26.163 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T08:00:26.169 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T08:00:26.170 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T08:00:26.357 INFO:teuthology.task.internal:Saving configuration 2024-09-11T08:00:26.368 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T08:00:26.512 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T08:00:26.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 07:55:29.241837', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAn11JuIdBtxPhstDZGZXWVrrnvDnlcGtIGZcLzq1bsJ8JGjJZgf5Hke5oj9O59jjdlvtScpPm1u1J9daawyw+A='} 2024-09-11T08:00:26.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 07:55:29.243761', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJz9HoUDgngTXRhlVwX9AVsHbTVNpW03xqxYJNp4oWbmg4z0sB47S2wbScPHyCnOsjeRfNNgV0MPeMtjoJ4Z8Y='} 2024-09-11T08:00:26.554 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T08:00:26.684 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-11T08:00:26.684 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-11T08:00:26.684 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T08:00:26.841 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8be58fac0>, signals=[15]) 2024-09-11T08:00:26.841 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T08:00:26.847 INFO:teuthology.task.internal:Opening connections... 2024-09-11T08:00:26.847 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-11T08:00:26.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:00:26.924 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T08:00:26.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:00:27.001 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T08:00:27.007 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-11T08:00:27.025 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-11T08:00:27.026 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-09-11T08:00:27.083 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T08:00:27.084 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T08:00:27.085 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-11T08:00:27.110 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-11T08:00:27.129 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-11T08:00:27.130 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-11T08:00:27.187 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-11T08:00:27.188 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T08:00:27.188 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-11T08:00:27.188 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T08:00:27.188 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T08:00:27.188 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T08:00:27.188 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-11T08:00:27.219 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T08:00:27.227 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T08:00:27.232 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T08:00:27.232 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-11T08:00:27.235 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-11T08:00:27.251 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T08:00:27.460 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T08:00:27.461 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-11T08:00:27.463 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-11T08:00:27.622 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T08:00:27.675 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T08:00:27.690 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T08:00:27.691 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T08:00:27.691 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T08:00:27.691 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T08:00:27.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:00:27.709 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-11T08:00:27.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:00:27.710 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-11T08:00:27.766 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-503.el9.x86_64 2024-09-11T08:00:27.766 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.14.0-503.el9.x86_64 2024-09-11T08:00:27.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2024-09-11T08:00:27.768 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-503.el9.x86_64 2024-09-11T08:00:27.768 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-503.el9.x86_64 2024-09-11T08:00:27.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-09-11T08:00:30.048 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T08:00:30.393 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-09-11T08:00:32.007 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-11T08:00:32.186 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-11T08:00:36.358 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-11T08:00:37.817 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-11T08:00:38.402 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-11T08:00:38.754 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T08:00:39.869 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-11T08:00:40.632 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-11T08:00:44.168 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-11T08:00:46.088 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T08:00:46.175 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T08:00:46.175 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T08:00:46.266 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T08:00:46.276 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 79 M 2024-09-11T08:00:46.277 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 126 M 2024-09-11T08:00:46.278 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:00:46.828 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 76 kB/s | 23 kB 00:00 2024-09-11T08:00:48.111 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T08:00:48.111 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T08:00:48.202 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T08:00:48.211 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 79 M 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 126 M 2024-09-11T08:00:48.212 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:00:48.347 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 264 kB/s | 23 kB 00:00 2024-09-11T08:00:48.639 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-11T08:00:49.056 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 43 MB/s | 35 MB 00:00 2024-09-11T08:00:49.315 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 30 MB/s | 29 MB 00:00 2024-09-11T08:00:49.315 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:00:49.315 INFO:teuthology.orchestra.run.smithi175.stdout:Total 71 MB/s | 79 MB 00:01 2024-09-11T08:00:49.994 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:00:50.335 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:00:50.335 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:00:51.344 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:00:51.345 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:00:53.780 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:00:54.421 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T08:00:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:00:55.385 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.8 MB/s | 16 MB 00:08 2024-09-11T08:00:57.292 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:00:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:01:02.257 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:01:02.542 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:07.402 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:07.793 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 1.4 MB/s | 29 MB 00:20 2024-09-11T08:01:09.509 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 1.5 MB/s | 35 MB 00:22 2024-09-11T08:01:09.509 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:01:09.510 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.4 MB/s | 79 MB 00:23 2024-09-11T08:01:10.192 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:01:10.536 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:01:10.536 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:01:11.519 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:01:11.520 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:01:13.946 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:01:14.600 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T08:01:14.801 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:01:17.585 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:01:17.716 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:01:22.555 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:01:22.675 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:27.530 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:45.432 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:45.471 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:45.869 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:45.869 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T08:01:45.869 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:01:45.869 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T08:01:46.724 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:01:46.725 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:01:47.086 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T08:01:47.165 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T08:01:47.166 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T08:01:47.166 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T08:01:47.166 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T08:01:47.166 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T08:01:47.166 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T08:01:47.166 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T08:01:47.166 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T08:01:47.225 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T08:01:47.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T08:01:47.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-09-11T08:01:47.256 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-09-11T08:01:47.256 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 82.el9 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8274670 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T08:01:47.257 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:01:47.258 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T08:01:47.259 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T08:01:47.259 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 5.14.0-505.el9.x86_64 2024-09-11T08:01:47.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T08:01:47.912 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-09-11T08:01:49.240 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T08:01:49.271 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-09-11T08:01:49.274 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-11T08:01:49.290 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.S2DrkqKOKQ 2024-09-11T08:01:49.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.S2DrkqKOKQ 2024-09-11T08:01:49.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.S2DrkqKOKQ 2024-09-11T08:01:49.496 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.S2DrkqKOKQ is 6KB 2024-09-11T08:01:49.544 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.S2DrkqKOKQ 2024-09-11T08:01:49.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T08:01:49.629 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T08:01:49.629 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T08:01:49.629 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T08:01:49.629 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T08:01:49.630 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T08:01:49.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-09-11T08:02:05.678 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:02:05.728 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:02:06.084 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:02:06.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T08:02:06.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T08:02:06.085 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T08:02:06.919 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T08:02:06.919 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:02:06.919 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:02:06.919 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T08:02:06.920 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T08:02:06.920 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T08:02:06.920 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T08:02:06.920 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:02:06.920 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:02:07.283 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T08:02:07.368 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T08:02:07.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T08:02:07.368 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T08:02:07.369 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T08:02:07.369 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T08:02:07.369 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T08:02:07.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T08:02:07.369 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T08:02:07.427 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T08:02:07.428 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T08:02:07.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 82.el9 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8274670 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T08:02:07.460 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:02:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T08:02:07.462 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T08:02:07.462 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 5.14.0-505.el9.x86_64 2024-09-11T08:02:07.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T08:02:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-09-11T08:02:09.327 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T08:02:09.359 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-09-11T08:02:09.361 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-09-11T08:02:09.377 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.tUI0V96RF8 2024-09-11T08:02:09.377 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tUI0V96RF8 2024-09-11T08:02:09.443 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.tUI0V96RF8 2024-09-11T08:02:09.588 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.tUI0V96RF8 is 6KB 2024-09-11T08:02:09.608 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.tUI0V96RF8 2024-09-11T08:02:09.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T08:02:09.686 INFO:teuthology.orchestra.run.smithi173.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T08:02:09.687 INFO:teuthology.orchestra.run.smithi173.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T08:02:09.687 INFO:teuthology.orchestra.run.smithi173.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T08:02:09.687 INFO:teuthology.orchestra.run.smithi173.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T08:02:09.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T08:02:09.854 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-09-11T08:02:19.780 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T08:02:19.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:02:19.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:02:38.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-09-11T08:02:39.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T08:02:39.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:02:39.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:02:47.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:02:47.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:02:50.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-09-11T08:02:58.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-11T08:03:02.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:03:02.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:03:07.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:03:07.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:03:10.301 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-11T08:03:20.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-09-11T08:03:22.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:03:22.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:03:35.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:03:35.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:03:36.170 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-11T08:03:36.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:03:36.553 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T08:03:36.554 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-11T08:03:36.568 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-505.el9.x86_64 2024-09-11T08:03:36.568 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T08:03:36.568 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T08:03:36.568 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T08:03:37.569 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T08:03:37.570 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T08:03:37.659 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-09-11T08:03:37.677 DEBUG:teuthology.parallel:result is None 2024-09-11T08:03:54.131 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-11T08:03:54.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:03:54.487 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T08:03:54.487 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-11T08:03:54.501 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-505.el9.x86_64 2024-09-11T08:03:54.501 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T08:03:54.501 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T08:03:54.501 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T08:03:55.503 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T08:03:55.503 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T08:03:55.596 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-09-11T08:03:55.636 DEBUG:teuthology.parallel:result is None 2024-09-11T08:03:55.637 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T08:03:55.644 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T08:03:55.645 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T08:03:55.647 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T08:03:55.666 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T08:03:55.731 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T08:03:55.798 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T08:03:55.798 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T08:03:55.800 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T08:03:55.834 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T08:03:55.861 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T08:03:55.861 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T08:03:55.863 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T08:03:55.886 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T08:03:55.896 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T08:03:55.906 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T08:03:55.917 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T08:03:55.919 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T08:03:55.925 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T08:03:55.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T08:03:55.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T08:03:55.985 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T08:03:55.994 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T08:03:55.994 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T08:03:55.998 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T08:03:56.042 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T08:03:56.090 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T08:03:56.135 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T08:03:56.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T08:03:56.250 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:03:56.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T08:03:56.311 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T08:03:56.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T08:03:56.419 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T08:03:56.461 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T08:03:56.501 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:03:56.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T08:03:56.566 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-11T08:03:56.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-11T08:03:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T08:03:56.653 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T08:03:57.143 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T08:03:57.151 INFO:teuthology.task.internal:Starting timer... 2024-09-11T08:03:57.151 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T08:03:57.209 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T08:03:57.261 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-11T08:03:57.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-09-11T08:03:57.364 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-09-11T08:03:57.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-11T08:03:57.445 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-11T08:03:57.447 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T08:03:57.447 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-09-11T08:03:57.497 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-09-11T08:03:57.498 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-11T08:03:57.530 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-11T08:03:57.530 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi173.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-11T08:03:57.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T08:03:57.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:03:57.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T08:03:57.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:03:57.650 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T08:03:57.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-09-11T08:03:57.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-11T08:03:57.770 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T08:03:57.782 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T08:03:57.793 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T08:03:57.793 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi173.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T08:07:41.482 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi173.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-11T08:07:41.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:07:41.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:07:41.564 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-11T08:07:41.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-11T08:07:41.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:07:41.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T08:07:41.730 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-11T08:07:41.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T08:07:41.809 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T08:07:41.820 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T08:07:41.820 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T08:07:41.821 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T08:07:41.823 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T08:07:41.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T08:07:41.851 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T08:07:41.866 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T08:07:41.879 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T08:07:41.891 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-09-11T08:07:41.894 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T08:07:41.902 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-09-11T08:07:41.916 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T08:07:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-11T08:07:41.929 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-11T08:07:41.930 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T08:07:41.944 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T08:07:41.958 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T08:07:41.987 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-11T08:07:41.991 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T08:07:41.991 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-11T08:07:41.991 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:41.991 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:41.992 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:41.992 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:42.013 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-11T08:07:42.016 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T08:07:42.016 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-11T08:07:42.017 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:42.017 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:42.017 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:42.017 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:07:42.018 INFO:teuthology.run_tasks:Running task pexec... 2024-09-11T08:07:42.032 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-11T08:07:42.032 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi173.front.sepia.ceph.com 2024-09-11T08:07:42.032 DEBUG:teuthology.orchestra.run.smithi173:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-11T08:07:42.033 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T08:07:42.033 DEBUG:teuthology.orchestra.run.smithi175:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-11T08:07:42.384 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:07:42.394 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:42.394 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Removing: 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Removing unused dependencies: 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Remove 2 Packages 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Freed space: 5.5 M 2024-09-11T08:07:42.395 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:07:42.399 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:07:42.399 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:07:42.406 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout:Removing: 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout:Removing unused dependencies: 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-11T08:07:42.415 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout:Remove 2 Packages 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout:Freed space: 5.5 M 2024-09-11T08:07:42.416 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:07:42.419 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:07:42.420 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:07:42.467 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:07:42.467 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:07:42.481 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:07:42.482 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:07:42.605 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:07:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:07:42.668 INFO:teuthology.orchestra.run.smithi173.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-11T08:07:42.694 INFO:teuthology.orchestra.run.smithi175.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-11T08:07:42.722 INFO:teuthology.orchestra.run.smithi173.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-11T08:07:42.749 INFO:teuthology.orchestra.run.smithi175.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-11T08:07:43.170 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-11T08:07:43.171 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-11T08:07:43.210 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-11T08:07:43.210 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout:Removed: 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:43.448 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout:Removed: 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:43.512 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:07:44.256 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Sep 2024 08:06:53 AM UTC. 2024-09-11T08:07:44.307 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 08:06:52 AM UTC. 2024-09-11T08:07:44.392 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:07:44.393 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:44.393 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:07:44.393 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:44.393 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:07:44.393 INFO:teuthology.orchestra.run.smithi173.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout:Install 7 Packages 2024-09-11T08:07:44.394 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:44.411 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.2 M 2024-09-11T08:07:44.411 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 19 M 2024-09-11T08:07:44.411 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:07:44.458 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:07:44.459 INFO:teuthology.orchestra.run.smithi175.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout:Install 7 Packages 2024-09-11T08:07:44.460 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:44.477 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 5.2 M 2024-09-11T08:07:44.477 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 19 M 2024-09-11T08:07:44.477 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:07:44.693 INFO:teuthology.orchestra.run.smithi173.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 318 kB/s | 44 kB 00:00 2024-09-11T08:07:44.735 INFO:teuthology.orchestra.run.smithi173.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 583 kB/s | 106 kB 00:00 2024-09-11T08:07:44.777 INFO:teuthology.orchestra.run.smithi173.stdout:(3/7): python3-configshell-1.1.30-1.el9.noarch. 856 kB/s | 72 kB 00:00 2024-09-11T08:07:44.803 INFO:teuthology.orchestra.run.smithi173.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.2 MB/s | 84 kB 00:00 2024-09-11T08:07:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:(5/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 2.8 MB/s | 906 kB 00:00 2024-09-11T08:07:44.956 INFO:teuthology.orchestra.run.smithi175.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 290 kB/s | 44 kB 00:00 2024-09-11T08:07:44.962 INFO:teuthology.orchestra.run.smithi173.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 4.4 MB/s | 837 kB 00:00 2024-09-11T08:07:44.981 INFO:teuthology.orchestra.run.smithi175.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 594 kB/s | 106 kB 00:00 2024-09-11T08:07:45.040 INFO:teuthology.orchestra.run.smithi175.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-11T08:07:45.066 INFO:teuthology.orchestra.run.smithi175.stdout:(4/7): python3-configshell-1.1.30-1.el9.noarch. 658 kB/s | 72 kB 00:00 2024-09-11T08:07:45.099 INFO:teuthology.orchestra.run.smithi175.stdout:(5/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 3.0 MB/s | 906 kB 00:00 2024-09-11T08:07:45.225 INFO:teuthology.orchestra.run.smithi175.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 4.4 MB/s | 837 kB 00:00 2024-09-11T08:07:45.895 INFO:teuthology.orchestra.run.smithi173.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 2.9 MB/s | 3.2 MB 00:01 2024-09-11T08:07:45.895 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:07:45.895 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.5 MB/s | 5.2 MB 00:01 2024-09-11T08:07:45.899 INFO:teuthology.orchestra.run.smithi175.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 3.8 MB/s | 3.2 MB 00:00 2024-09-11T08:07:45.900 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:07:45.900 INFO:teuthology.orchestra.run.smithi175.stdout:Total 3.6 MB/s | 5.2 MB 00:01 2024-09-11T08:07:46.004 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:07:46.016 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:07:46.019 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:07:46.019 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:07:46.031 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:07:46.031 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:07:46.321 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:07:46.321 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:07:46.371 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:07:46.372 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:07:46.790 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:07:46.851 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:07:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-11T08:07:46.924 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-11T08:07:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-11T08:07:46.952 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-11T08:07:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-11T08:07:47.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-11T08:07:47.165 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-11T08:07:47.200 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-11T08:07:47.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-11T08:07:47.240 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-11T08:07:47.640 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-11T08:07:47.669 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-11T08:07:47.682 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-11T08:07:47.709 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-11T08:07:47.784 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-11T08:07:47.830 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-11T08:07:47.857 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:47.897 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:48.816 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:48.816 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-11T08:07:48.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-11T08:07:48.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-11T08:07:48.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-11T08:07:48.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-11T08:07:48.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-11T08:07:48.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-11T08:07:49.195 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-11T08:07:49.196 INFO:teuthology.orchestra.run.smithi173.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-11T08:07:49.196 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:07:49.196 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:07:49.241 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-11T08:07:49.241 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:49.241 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:07:49.242 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:07:49.561 DEBUG:teuthology.parallel:result is None 2024-09-11T08:07:49.596 DEBUG:teuthology.parallel:result is None 2024-09-11T08:07:49.597 INFO:teuthology.run_tasks:Running task install... 2024-09-11T08:07:49.606 DEBUG:teuthology.task.install:project ceph 2024-09-11T08:07:49.606 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd0e6828a2016d48cf25ad84064e50742bb1c39b9'}} 2024-09-11T08:07:49.607 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd0e6828a2016d48cf25ad84064e50742bb1c39b9'} 2024-09-11T08:07:49.607 INFO:teuthology.task.install:Using flavor: default 2024-09-11T08:07:49.613 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T08:07:49.613 INFO:teuthology.task.install:extra packages: [] 2024-09-11T08:07:49.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd0e6828a2016d48cf25ad84064e50742bb1c39b9', 'tag': None, 'wait_for_package': False} 2024-09-11T08:07:49.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:07:49.617 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd0e6828a2016d48cf25ad84064e50742bb1c39b9', 'tag': None, 'wait_for_package': False} 2024-09-11T08:07:49.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:07:49.770 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/ 2024-09-11T08:07:49.771 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1623.gd0e6828a 2024-09-11T08:07:49.774 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/ 2024-09-11T08:07:49.774 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1623.gd0e6828a 2024-09-11T08:07:49.882 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T08:07:49.884 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:07:49.884 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T08:07:49.895 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-guits-quincy-2024-09-10-2008-quincy/d0e6828a2016d48cf25ad84064e50742bb1c39b9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T08:07:49.895 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:07:49.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T08:07:49.911 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T08:07:49.911 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d0e6828a2016d48cf25ad84064e50742bb1c39b9/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T08:07:49.921 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T08:07:49.921 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d0e6828a2016d48cf25ad84064e50742bb1c39b9/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T08:07:49.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T08:07:49.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T08:07:50.053 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T08:07:50.073 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T08:07:50.128 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-09-11T08:07:50.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-09-11T08:07:50.138 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-11T08:07:50.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-11T08:07:50.364 INFO:teuthology.orchestra.run.smithi173.stdout:45 files removed 2024-09-11T08:07:50.377 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-11T08:07:50.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2024-09-11T08:07:50.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw 2024-09-11T08:07:50.953 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 297 kB/s | 77 kB 00:00 2024-09-11T08:07:50.953 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 283 kB/s | 77 kB 00:00 2024-09-11T08:07:51.225 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 47 kB/s | 11 kB 00:00 2024-09-11T08:07:51.236 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-11T08:07:51.484 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-11T08:07:51.511 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-11T08:07:52.619 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.2 MB 00:01 2024-09-11T08:07:53.084 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-11T08:07:58.729 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:05 2024-09-11T08:08:03.554 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.5 MB 00:01 2024-09-11T08:08:05.130 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-11T08:08:05.909 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T08:08:11.406 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T08:08:13.616 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-11T08:08:13.789 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 14 M 2024-09-11T08:08:13.791 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 3.1 M 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.9 M 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 5.0 M 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 23 M 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 25 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 636 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 457 k 2024-09-11T08:08:13.792 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 4.9 M 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 45 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 120 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 156 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 320 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 294 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 99 k 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T08:08:13.793 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:Install 22 Packages 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 58 M 2024-09-11T08:08:13.794 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:08:14.549 INFO:teuthology.orchestra.run.smithi173.stdout:(1/24): ceph-base-17.2.7-1623.gd0e6828a.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-11T08:08:14.616 INFO:teuthology.orchestra.run.smithi173.stdout:(2/24): ceph-selinux-17.2.7-1623.gd0e6828a.el9. 378 kB/s | 25 kB 00:00 2024-09-11T08:08:14.725 INFO:teuthology.orchestra.run.smithi173.stdout:(3/24): libcephfs2-17.2.7-1623.gd0e6828a.el9.x8 5.7 MB/s | 636 kB 00:00 2024-09-11T08:08:14.825 INFO:teuthology.orchestra.run.smithi173.stdout:(4/24): libradosstriper1-17.2.7-1623.gd0e6828a. 4.5 MB/s | 457 kB 00:00 2024-09-11T08:08:14.975 INFO:teuthology.orchestra.run.smithi173.stdout:(5/24): ceph-radosgw-17.2.7-1623.gd0e6828a.el9. 16 MB/s | 14 MB 00:00 2024-09-11T08:08:15.017 INFO:teuthology.orchestra.run.smithi173.stdout:(6/24): python3-ceph-argparse-17.2.7-1623.gd0e6 1.1 MB/s | 45 kB 00:00 2024-09-11T08:08:15.101 INFO:teuthology.orchestra.run.smithi173.stdout:(7/24): librgw2-17.2.7-1623.gd0e6828a.el9.x86_6 18 MB/s | 4.9 MB 00:00 2024-09-11T08:08:15.126 INFO:teuthology.orchestra.run.smithi173.stdout:(8/24): python3-ceph-common-17.2.7-1623.gd0e682 1.1 MB/s | 120 kB 00:00 2024-09-11T08:08:15.151 INFO:teuthology.orchestra.run.smithi173.stdout:(9/24): python3-cephfs-17.2.7-1623.gd0e6828a.el 3.0 MB/s | 156 kB 00:00 2024-09-11T08:08:15.177 INFO:teuthology.orchestra.run.smithi173.stdout:(10/24): python3-rados-17.2.7-1623.gd0e6828a.el 6.2 MB/s | 320 kB 00:00 2024-09-11T08:08:15.202 INFO:teuthology.orchestra.run.smithi173.stdout:(11/24): python3-rbd-17.2.7-1623.gd0e6828a.el9. 5.7 MB/s | 294 kB 00:00 2024-09-11T08:08:15.227 INFO:teuthology.orchestra.run.smithi173.stdout:(12/24): python3-rgw-17.2.7-1623.gd0e6828a.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T08:08:15.461 INFO:teuthology.orchestra.run.smithi173.stdout:(13/24): ceph-common-17.2.7-1623.gd0e6828a.el9. 16 MB/s | 23 MB 00:01 2024-09-11T08:08:15.486 INFO:teuthology.orchestra.run.smithi173.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 175 kB/s | 45 kB 00:00 2024-09-11T08:08:15.520 INFO:teuthology.orchestra.run.smithi173.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 505 kB/s | 160 kB 00:00 2024-09-11T08:08:15.561 INFO:teuthology.orchestra.run.smithi173.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-11T08:08:15.595 INFO:teuthology.orchestra.run.smithi173.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-11T08:08:15.637 INFO:teuthology.orchestra.run.smithi173.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-09-11T08:08:15.671 INFO:teuthology.orchestra.run.smithi173.stdout:(19/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-11T08:08:15.696 INFO:teuthology.orchestra.run.smithi173.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-11T08:08:15.730 INFO:teuthology.orchestra.run.smithi173.stdout:(21/24): liboath-2.6.7-2.el9.x86_64.rpm 367 kB/s | 49 kB 00:00 2024-09-11T08:08:15.780 INFO:teuthology.orchestra.run.smithi173.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T08:08:15.872 INFO:teuthology.orchestra.run.smithi173.stdout:(23/24): librados2-17.2.7-1623.gd0e6828a.el9.x8 18 MB/s | 3.1 MB 00:00 2024-09-11T08:08:15.930 INFO:teuthology.orchestra.run.smithi173.stdout:(24/24): librbd1-17.2.7-1623.gd0e6828a.el9.x86_ 15 MB/s | 2.9 MB 00:00 2024-09-11T08:08:15.935 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:08:16.015 INFO:teuthology.orchestra.run.smithi173.stdout:Total 27 MB/s | 58 MB 00:02 2024-09-11T08:08:16.016 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:08:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:08:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:08:16.491 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:08:16.491 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:08:17.682 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:08:18.009 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-11T08:08:18.116 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:18.209 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:18.233 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.5 MB 00:00 2024-09-11T08:08:18.286 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/26 2024-09-11T08:08:18.317 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:18.405 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:18.451 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-11T08:08:18.480 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-11T08:08:18.925 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-11T08:08:18.953 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 8/26 2024-09-11T08:08:19.016 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 8/26 2024-09-11T08:08:19.052 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-11T08:08:19.096 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9. 10/26 2024-09-11T08:08:19.132 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 11/26 2024-09-11T08:08:19.195 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 12/26 2024-09-11T08:08:19.222 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 13/26 2024-09-11T08:08:19.288 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 13/26 2024-09-11T08:08:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-11T08:08:19.381 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-11T08:08:19.413 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-11T08:08:19.634 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 19 kB 00:00 2024-09-11T08:08:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-11T08:08:19.752 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 18/26 2024-09-11T08:08:19.841 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 18/26 2024-09-11T08:08:19.915 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 19/26 2024-09-11T08:08:19.945 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x8 20/26 2024-09-11T08:08:20.563 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T08:08:22.380 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:22.418 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:22.945 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:22.979 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 22/26 2024-09-11T08:08:23.084 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 22/26 2024-09-11T08:08:23.084 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T08:08:23.084 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T08:08:23.084 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:25.910 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-11T08:08:28.307 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 14 M 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 3.1 M 2024-09-11T08:08:28.309 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.9 M 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 5.0 M 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 23 M 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 25 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 636 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 457 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T08:08:28.310 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 4.9 M 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 45 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 120 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 156 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 320 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 294 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 99 k 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:08:28.311 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:28.312 INFO:teuthology.orchestra.run.smithi175.stdout:Install 22 Packages 2024-09-11T08:08:28.312 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 2 Packages 2024-09-11T08:08:28.312 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:28.312 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 58 M 2024-09-11T08:08:28.312 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:08:29.290 INFO:teuthology.orchestra.run.smithi175.stdout:(1/24): ceph-base-17.2.7-1623.gd0e6828a.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-11T08:08:29.359 INFO:teuthology.orchestra.run.smithi175.stdout:(2/24): ceph-selinux-17.2.7-1623.gd0e6828a.el9. 378 kB/s | 25 kB 00:00 2024-09-11T08:08:29.447 INFO:teuthology.orchestra.run.smithi175.stdout:(3/24): libcephfs2-17.2.7-1623.gd0e6828a.el9.x8 6.8 MB/s | 636 kB 00:00 2024-09-11T08:08:29.537 INFO:teuthology.orchestra.run.smithi175.stdout:(4/24): libradosstriper1-17.2.7-1623.gd0e6828a. 4.9 MB/s | 457 kB 00:00 2024-09-11T08:08:29.729 INFO:teuthology.orchestra.run.smithi175.stdout:(5/24): ceph-radosgw-17.2.7-1623.gd0e6828a.el9. 16 MB/s | 14 MB 00:00 2024-09-11T08:08:29.762 INFO:teuthology.orchestra.run.smithi175.stdout:(6/24): python3-ceph-argparse-17.2.7-1623.gd0e6 1.3 MB/s | 45 kB 00:00 2024-09-11T08:08:29.863 INFO:teuthology.orchestra.run.smithi175.stdout:(7/24): librgw2-17.2.7-1623.gd0e6828a.el9.x86_6 15 MB/s | 4.9 MB 00:00 2024-09-11T08:08:29.897 INFO:teuthology.orchestra.run.smithi175.stdout:(8/24): python3-ceph-common-17.2.7-1623.gd0e682 898 kB/s | 120 kB 00:00 2024-09-11T08:08:29.922 INFO:teuthology.orchestra.run.smithi175.stdout:(9/24): python3-cephfs-17.2.7-1623.gd0e6828a.el 2.6 MB/s | 156 kB 00:00 2024-09-11T08:08:29.947 INFO:teuthology.orchestra.run.smithi175.stdout:(10/24): python3-rados-17.2.7-1623.gd0e6828a.el 6.3 MB/s | 320 kB 00:00 2024-09-11T08:08:29.972 INFO:teuthology.orchestra.run.smithi175.stdout:(11/24): python3-rbd-17.2.7-1623.gd0e6828a.el9. 5.7 MB/s | 294 kB 00:00 2024-09-11T08:08:29.998 INFO:teuthology.orchestra.run.smithi175.stdout:(12/24): python3-rgw-17.2.7-1623.gd0e6828a.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T08:08:30.232 INFO:teuthology.orchestra.run.smithi175.stdout:(13/24): ceph-common-17.2.7-1623.gd0e6828a.el9. 16 MB/s | 23 MB 00:01 2024-09-11T08:08:30.257 INFO:teuthology.orchestra.run.smithi175.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 175 kB/s | 45 kB 00:00 2024-09-11T08:08:30.307 INFO:teuthology.orchestra.run.smithi175.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 480 kB/s | 160 kB 00:00 2024-09-11T08:08:30.349 INFO:teuthology.orchestra.run.smithi175.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-11T08:08:30.374 INFO:teuthology.orchestra.run.smithi175.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 632 kB/s | 42 kB 00:00 2024-09-11T08:08:30.424 INFO:teuthology.orchestra.run.smithi175.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-09-11T08:08:30.450 INFO:teuthology.orchestra.run.smithi175.stdout:(19/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-11T08:08:30.475 INFO:teuthology.orchestra.run.smithi175.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 482 kB/s | 49 kB 00:00 2024-09-11T08:08:30.508 INFO:teuthology.orchestra.run.smithi175.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 820 kB/s | 67 kB 00:00 2024-09-11T08:08:30.567 INFO:teuthology.orchestra.run.smithi175.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T08:08:30.661 INFO:teuthology.orchestra.run.smithi175.stdout:(23/24): librados2-17.2.7-1623.gd0e6828a.el9.x8 17 MB/s | 3.1 MB 00:00 2024-09-11T08:08:30.734 INFO:teuthology.orchestra.run.smithi175.stdout:(24/24): librbd1-17.2.7-1623.gd0e6828a.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-11T08:08:30.739 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:08:30.739 INFO:teuthology.orchestra.run.smithi175.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-11T08:08:30.799 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:08:30.830 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:08:30.831 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:08:31.303 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:08:31.303 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:08:32.508 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:08:32.870 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-11T08:08:32.961 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:33.045 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/26 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-09-11T08:08:33.142 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:33.234 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:33.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-11T08:08:33.318 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-11T08:08:33.757 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-11T08:08:33.790 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 8/26 2024-09-11T08:08:33.853 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 8/26 2024-09-11T08:08:33.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-11T08:08:33.941 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9. 10/26 2024-09-11T08:08:33.986 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 11/26 2024-09-11T08:08:34.049 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 12/26 2024-09-11T08:08:34.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 13/26 2024-09-11T08:08:34.141 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 13/26 2024-09-11T08:08:34.183 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-11T08:08:34.217 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-11T08:08:34.250 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-11T08:08:34.447 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 24/26 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 24/26 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T08:08:34.526 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:34.528 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-11T08:08:34.543 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-11T08:08:34.596 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 18/26 2024-09-11T08:08:34.633 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-11T08:08:34.633 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:34.685 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 18/26 2024-09-11T08:08:34.767 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 19/26 2024-09-11T08:08:34.799 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x8 20/26 2024-09-11T08:08:35.875 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:35.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/26 2024-09-11T08:08:35.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:35.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/26 2024-09-11T08:08:35.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 5/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 6/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 7/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9. 8/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x8 9/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 10/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 11/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 12/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 13/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-11T08:08:35.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-11T08:08:35.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 25/26 2024-09-11T08:08:36.739 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T08:08:36.740 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T08:08:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:36.742 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T08:08:36.742 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:36.742 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:08:37.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2024-09-11T08:08:37.269 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:37.312 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:26 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:08:37.789 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 48 M 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 163 k 2024-09-11T08:08:37.790 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 48 M 2024-09-11T08:08:37.791 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 193 M 2024-09-11T08:08:37.792 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:08:37.827 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 21/26 2024-09-11T08:08:37.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 22/26 2024-09-11T08:08:37.962 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 22/26 2024-09-11T08:08:37.962 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T08:08:37.962 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T08:08:37.963 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:37.991 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:38.053 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): libcephsqlite-17.2.7-1623.gd0e6828a.el9. 780 kB/s | 163 kB 00:00 2024-09-11T08:08:38.078 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-11T08:08:38.203 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 425 kB/s | 64 kB 00:00 2024-09-11T08:08:39.370 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): ceph-test-17.2.7-1623.gd0e6828a.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-11T08:08:39.372 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:08:39.373 INFO:teuthology.orchestra.run.smithi173.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-11T08:08:39.401 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:08:39.420 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:08:39.420 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:08:39.786 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:08:39.786 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:08:40.313 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:08:40.408 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T08:08:40.452 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T08:08:40.481 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/4 2024-09-11T08:08:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/4 2024-09-11T08:08:44.978 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/4 2024-09-11T08:08:47.253 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/4 2024-09-11T08:08:47.253 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/4 2024-09-11T08:08:47.254 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/4 2024-09-11T08:08:47.254 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T08:08:47.593 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T08:08:47.594 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:47.594 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:08:47.913 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-11T08:08:48.090 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:48.477 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:37 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:08:48.624 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 6.5 k 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:08:48.627 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.1 M 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 1.4 M 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 240 k 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 3.9 M 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 15 M 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T08:08:48.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T08:08:48.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T08:08:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout:Install 34 Packages 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 27 M 2024-09-11T08:08:48.631 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 96 M 2024-09-11T08:08:48.632 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:08:49.140 INFO:teuthology.orchestra.run.smithi173.stdout:(1/34): ceph-17.2.7-1623.gd0e6828a.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-11T08:08:49.340 INFO:teuthology.orchestra.run.smithi173.stdout:(2/34): ceph-mds-17.2.7-1623.gd0e6828a.el9.x86_ 6.5 MB/s | 2.1 MB 00:00 2024-09-11T08:08:49.374 INFO:teuthology.orchestra.run.smithi173.stdout:(3/34): ceph-mgr-17.2.7-1623.gd0e6828a.el9.x86_ 4.0 MB/s | 1.4 MB 00:00 2024-09-11T08:08:49.413 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 24/26 2024-09-11T08:08:49.458 INFO:teuthology.orchestra.run.smithi173.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1623.gd0e6 2.8 MB/s | 240 kB 00:00 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 24/26 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T08:08:49.490 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:49.492 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-11T08:08:49.517 INFO:teuthology.orchestra.run.smithi173.stdout:(5/34): ceph-mon-17.2.7-1623.gd0e6828a.el9.x86_ 10 MB/s | 3.9 MB 00:00 2024-09-11T08:08:49.591 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-11T08:08:49.591 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:49.625 INFO:teuthology.orchestra.run.smithi173.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-11T08:08:49.667 INFO:teuthology.orchestra.run.smithi173.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T08:08:49.826 INFO:teuthology.orchestra.run.smithi173.stdout:(8/34): ceph-osd-17.2.7-1623.gd0e6828a.el9.x86_ 32 MB/s | 15 MB 00:00 2024-09-11T08:08:49.851 INFO:teuthology.orchestra.run.smithi173.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 736 kB/s | 135 kB 00:00 2024-09-11T08:08:49.885 INFO:teuthology.orchestra.run.smithi173.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 3.3 MB/s | 1.2 MB 00:00 2024-09-11T08:08:49.927 INFO:teuthology.orchestra.run.smithi173.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-11T08:08:49.952 INFO:teuthology.orchestra.run.smithi173.stdout:(12/34): python3-requests-2.25.1-8.el9.noarch.r 995 kB/s | 125 kB 00:00 2024-09-11T08:08:50.035 INFO:teuthology.orchestra.run.smithi173.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-11T08:08:50.069 INFO:teuthology.orchestra.run.smithi173.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-09-11T08:08:50.094 INFO:teuthology.orchestra.run.smithi173.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 542 kB/s | 77 kB 00:00 2024-09-11T08:08:50.128 INFO:teuthology.orchestra.run.smithi173.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-11T08:08:50.153 INFO:teuthology.orchestra.run.smithi173.stdout:(17/34): python3-pytz-2021.1-5.el9.noarch.rpm 434 kB/s | 51 kB 00:00 2024-09-11T08:08:50.187 INFO:teuthology.orchestra.run.smithi173.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-11T08:08:50.220 INFO:teuthology.orchestra.run.smithi173.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-11T08:08:50.245 INFO:teuthology.orchestra.run.smithi173.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 764 kB/s | 18 kB 00:00 2024-09-11T08:08:50.271 INFO:teuthology.orchestra.run.smithi173.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-11T08:08:50.296 INFO:teuthology.orchestra.run.smithi173.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-11T08:08:50.321 INFO:teuthology.orchestra.run.smithi173.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-11T08:08:50.346 INFO:teuthology.orchestra.run.smithi173.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-11T08:08:50.372 INFO:teuthology.orchestra.run.smithi173.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 918 kB/s | 46 kB 00:00 2024-09-11T08:08:50.397 INFO:teuthology.orchestra.run.smithi173.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T08:08:50.422 INFO:teuthology.orchestra.run.smithi173.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 658 kB/s | 16 kB 00:00 2024-09-11T08:08:50.448 INFO:teuthology.orchestra.run.smithi173.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-11T08:08:50.473 INFO:teuthology.orchestra.run.smithi173.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-11T08:08:50.498 INFO:teuthology.orchestra.run.smithi173.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-11T08:08:50.524 INFO:teuthology.orchestra.run.smithi173.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T08:08:50.549 INFO:teuthology.orchestra.run.smithi173.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-11T08:08:50.574 INFO:teuthology.orchestra.run.smithi173.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T08:08:50.608 INFO:teuthology.orchestra.run.smithi173.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-11T08:08:50.612 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:08:50.612 INFO:teuthology.orchestra.run.smithi173.stdout:Total 14 MB/s | 27 MB 00:01 2024-09-11T08:08:50.737 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:08:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:08:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 5/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_6 6/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 7/26 2024-09-11T08:08:50.880 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9. 8/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x8 9/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 10/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 11/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 12/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 13/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-11T08:08:50.881 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-11T08:08:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-11T08:08:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 23/26 2024-09-11T08:08:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-11T08:08:50.882 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 25/26 2024-09-11T08:08:51.148 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:08:51.148 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.917 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.918 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:51.919 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:08:52.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-test 2024-09-11T08:08:52.427 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:08:52.486 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-11T08:08:52.527 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-11T08:08:52.559 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-11T08:08:52.650 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-11T08:08:52.729 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-11T08:08:52.770 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-11T08:08:52.814 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-11T08:08:52.860 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-11T08:08:52.871 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:27 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:08:52.895 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-11T08:08:52.928 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-11T08:08:52.969 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-11T08:08:53.010 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:08:53.010 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 48 M 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 163 k 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:08:53.011 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:08:53.012 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-09-11T08:08:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:08:53.012 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 48 M 2024-09-11T08:08:53.012 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 193 M 2024-09-11T08:08:53.012 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:08:53.015 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-11T08:08:53.055 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-11T08:08:53.103 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-11T08:08:53.136 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-11T08:08:53.208 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-11T08:08:53.213 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-11T08:08:53.255 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-11T08:08:53.305 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): libcephsqlite-17.2.7-1623.gd0e6828a.el9. 670 kB/s | 163 kB 00:00 2024-09-11T08:08:53.346 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-11T08:08:53.426 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-11T08:08:53.488 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-11T08:08:53.536 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-11T08:08:53.592 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-11T08:08:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-11T08:08:53.832 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-11T08:08:53.881 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-11T08:08:53.958 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-11T08:08:54.047 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-11T08:08:54.095 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-11T08:08:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-11T08:08:54.369 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9. 29/34 2024-09-11T08:08:54.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 30/34 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 30/34 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T08:08:54.425 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:54.572 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): ceph-test-17.2.7-1623.gd0e6828a.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-11T08:08:54.574 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:08:54.574 INFO:teuthology.orchestra.run.smithi175.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-11T08:08:54.600 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:08:54.618 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:08:54.618 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:08:54.982 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:08:54.982 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:08:55.511 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:08:55.610 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T08:08:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T08:08:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/4 2024-09-11T08:08:55.784 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 31/34 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 31/34 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T08:08:55.814 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:56.186 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 32/34 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 32/34 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T08:08:56.211 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:56.420 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 33/34 2024-09-11T08:08:56.444 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 33/34 2024-09-11T08:08:56.444 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:08:56.444 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T08:08:56.445 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T08:08:56.445 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T08:08:56.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:56.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 34/34 2024-09-11T08:08:58.165 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 34/34 2024-09-11T08:08:58.165 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/34 2024-09-11T08:08:58.165 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/34 2024-09-11T08:08:58.165 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/34 2024-09-11T08:08:58.165 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 5/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9. 6/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-11T08:08:58.166 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-11T08:08:58.167 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-11T08:08:58.168 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:59.048 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T08:08:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T08:08:59.050 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T08:08:59.051 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T08:08:59.051 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T08:08:59.051 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T08:08:59.051 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:08:59.051 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:08:59.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2024-09-11T08:08:59.970 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:48 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:00.062 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:00.103 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:00.104 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:00.104 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:00.148 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/4 2024-09-11T08:09:00.172 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2024-09-11T08:09:00.224 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/4 2024-09-11T08:09:00.727 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:49 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:00.857 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 83 k 2024-09-11T08:09:00.858 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 83 k 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 375 k 2024-09-11T08:09:00.859 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:01.052 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-17.2.7-1623.gd0e6828a.el9.noarch.rpm 430 kB/s | 83 kB 00:00 2024-09-11T08:09:01.637 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Total 426 kB/s | 83 kB 00:00 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:01.638 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:01.681 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:02.021 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:02.275 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:02.488 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T08:09:02.489 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/4 2024-09-11T08:09:02.489 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/4 2024-09-11T08:09:02.489 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/4 2024-09-11T08:09:02.489 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T08:09:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:02.810 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:03.058 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:03.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph 2024-09-11T08:09:03.193 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:03.194 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:03.194 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-09-11T08:09:03.194 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:03.195 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:03.195 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 137 k 2024-09-11T08:09:03.195 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:03.195 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:03.195 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:03.196 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:03.196 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:03.196 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 137 k 2024-09-11T08:09:03.196 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 379 k 2024-09-11T08:09:03.196 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:03.399 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-17.2.7-1623.gd0e682 669 kB/s | 137 kB 00:00 2024-09-11T08:09:03.400 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:03.400 INFO:teuthology.orchestra.run.smithi173.stdout:Total 664 kB/s | 137 kB 00:00 2024-09-11T08:09:03.401 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:03.408 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:03.408 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:03.465 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:03.465 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:03.623 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:03.690 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:38 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:03.692 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:03.717 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:03.718 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:03.718 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T08:09:03.718 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:03.826 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:03.829 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:03.829 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:03.829 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 6.5 k 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.1 M 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 1.4 M 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 240 k 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 3.9 M 2024-09-11T08:09:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 15 M 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T08:09:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T08:09:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T08:09:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections 2024-09-11T08:09:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T08:09:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T08:09:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T08:09:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T08:09:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout:Install 34 Packages 2024-09-11T08:09:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:03.836 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 27 M 2024-09-11T08:09:03.836 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 96 M 2024-09-11T08:09:03.836 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:04.409 INFO:teuthology.orchestra.run.smithi175.stdout:(1/34): ceph-17.2.7-1623.gd0e6828a.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T08:09:04.593 INFO:teuthology.orchestra.run.smithi175.stdout:(2/34): ceph-mgr-17.2.7-1623.gd0e6828a.el9.x86_ 4.4 MB/s | 1.4 MB 00:00 2024-09-11T08:09:04.616 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:04.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:04.616 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:04.617 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:04.617 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:04.617 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:04.634 INFO:teuthology.orchestra.run.smithi175.stdout:(3/34): ceph-mds-17.2.7-1623.gd0e6828a.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-09-11T08:09:04.735 INFO:teuthology.orchestra.run.smithi175.stdout:(4/34): ceph-mon-17.2.7-1623.gd0e6828a.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-11T08:09:04.760 INFO:teuthology.orchestra.run.smithi175.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1623.gd0e6 1.9 MB/s | 240 kB 00:00 2024-09-11T08:09:04.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2024-09-11T08:09:05.089 INFO:teuthology.orchestra.run.smithi175.stdout:(6/34): ceph-osd-17.2.7-1623.gd0e6828a.el9.x86_ 31 MB/s | 15 MB 00:00 2024-09-11T08:09:05.412 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:05.506 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:05.548 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:05.549 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:05.549 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:05.620 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T08:09:05.727 INFO:teuthology.orchestra.run.smithi175.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 255 kB/s | 253 kB 00:00 2024-09-11T08:09:05.760 INFO:teuthology.orchestra.run.smithi175.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 161 kB/s | 106 kB 00:00 2024-09-11T08:09:05.844 INFO:teuthology.orchestra.run.smithi175.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-11T08:09:06.185 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:06.322 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 3.4 M 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 24 k 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 15 k 2024-09-11T08:09:06.323 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout:Install 7 Packages 2024-09-11T08:09:06.324 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:06.325 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.7 M 2024-09-11T08:09:06.325 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 80 M 2024-09-11T08:09:06.325 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:06.461 INFO:teuthology.orchestra.run.smithi175.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-11T08:09:06.486 INFO:teuthology.orchestra.run.smithi175.stdout:(11/34): python3-pycparser-2.20-6.el9.noarch.rp 178 kB/s | 135 kB 00:00 2024-09-11T08:09:06.578 INFO:teuthology.orchestra.run.smithi175.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 379 kB/s | 35 kB 00:00 2024-09-11T08:09:06.603 INFO:teuthology.orchestra.run.smithi175.stdout:(13/34): python3-urllib3-1.26.5-6.el9.noarch.rp 283 kB/s | 215 kB 00:00 2024-09-11T08:09:06.629 INFO:teuthology.orchestra.run.smithi175.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-11T08:09:06.637 INFO:teuthology.orchestra.run.smithi173.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1623.gd0e6 102 kB/s | 15 kB 00:00 2024-09-11T08:09:06.662 INFO:teuthology.orchestra.run.smithi173.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1623.gd0e 144 kB/s | 24 kB 00:00 2024-09-11T08:09:06.670 INFO:teuthology.orchestra.run.smithi175.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 843 kB/s | 77 kB 00:00 2024-09-11T08:09:06.696 INFO:teuthology.orchestra.run.smithi175.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-11T08:09:06.703 INFO:teuthology.orchestra.run.smithi173.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-11T08:09:06.721 INFO:teuthology.orchestra.run.smithi175.stdout:(17/34): python3-pytz-2021.1-5.el9.noarch.rpm 434 kB/s | 51 kB 00:00 2024-09-11T08:09:06.729 INFO:teuthology.orchestra.run.smithi173.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-11T08:09:06.754 INFO:teuthology.orchestra.run.smithi173.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-11T08:09:06.763 INFO:teuthology.orchestra.run.smithi175.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-11T08:09:06.779 INFO:teuthology.orchestra.run.smithi173.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-11T08:09:06.788 INFO:teuthology.orchestra.run.smithi175.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-11T08:09:06.813 INFO:teuthology.orchestra.run.smithi175.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-11T08:09:06.830 INFO:teuthology.orchestra.run.smithi175.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 424 kB/s | 18 kB 00:00 2024-09-11T08:09:06.856 INFO:teuthology.orchestra.run.smithi175.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2024-09-11T08:09:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-11T08:09:06.888 INFO:teuthology.orchestra.run.smithi173.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1623.gd0e6828a 8.5 MB/s | 3.4 MB 00:00 2024-09-11T08:09:06.891 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:06.892 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.4 MB/s | 3.7 MB 00:00 2024-09-11T08:09:06.892 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:06.900 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:06.900 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:06.906 INFO:teuthology.orchestra.run.smithi175.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-11T08:09:06.931 INFO:teuthology.orchestra.run.smithi175.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-11T08:09:06.957 INFO:teuthology.orchestra.run.smithi175.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T08:09:06.982 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:06.983 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:06.990 INFO:teuthology.orchestra.run.smithi175.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-11T08:09:07.016 INFO:teuthology.orchestra.run.smithi175.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-11T08:09:07.049 INFO:teuthology.orchestra.run.smithi175.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-11T08:09:07.074 INFO:teuthology.orchestra.run.smithi175.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-09-11T08:09:07.125 INFO:teuthology.orchestra.run.smithi175.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-11T08:09:07.150 INFO:teuthology.orchestra.run.smithi175.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 810 kB/s | 20 kB 00:00 2024-09-11T08:09:07.175 INFO:teuthology.orchestra.run.smithi175.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-11T08:09:07.209 INFO:teuthology.orchestra.run.smithi175.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-09-11T08:09:07.214 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:07.214 INFO:teuthology.orchestra.run.smithi175.stdout:Total 8.1 MB/s | 27 MB 00:03 2024-09-11T08:09:07.288 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:07.343 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:07.347 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-11T08:09:07.378 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:07.378 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:07.381 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-11T08:09:07.428 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-11T08:09:07.461 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-11T08:09:07.488 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.n 5/7 2024-09-11T08:09:07.785 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:07.785 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:08.481 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9. 6/7 2024-09-11T08:09:08.517 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 7/7 2024-09-11T08:09:09.026 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:09.087 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-11T08:09:09.119 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-11T08:09:09.152 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-11T08:09:09.243 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-11T08:09:09.322 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-11T08:09:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-11T08:09:09.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-11T08:09:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-11T08:09:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-11T08:09:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-11T08:09:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 7/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9. 1/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 2/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.n 3/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-11T08:09:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-11T08:09:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-11T08:09:09.588 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-11T08:09:09.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-11T08:09:09.670 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-11T08:09:09.702 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-11T08:09:09.776 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T08:09:09.800 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T08:09:09.801 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:09.801 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:09.922 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-11T08:09:10.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-11T08:09:10.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T08:09:10.054 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-11T08:09:10.093 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-11T08:09:10.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-11T08:09:10.197 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-11T08:09:10.383 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-11T08:09:10.430 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-11T08:09:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-11T08:09:10.586 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-11T08:09:10.594 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:10.652 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-11T08:09:10.728 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:10.729 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-11T08:09:10.729 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 7.4 M 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T08:09:10.730 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-09-11T08:09:10.731 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:10.732 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 38 M 2024-09-11T08:09:10.732 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 212 M 2024-09-11T08:09:10.732 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:10.771 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-11T08:09:10.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9. 29/34 2024-09-11T08:09:10.956 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 30/34 2024-09-11T08:09:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 30/34 2024-09-11T08:09:10.983 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:10.983 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T08:09:10.983 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T08:09:10.983 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T08:09:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:11.046 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-11T08:09:11.130 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-11T08:09:11.155 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-11T08:09:11.205 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-11T08:09:11.272 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-11T08:09:11.397 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-11T08:09:11.548 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.2 MB/s | 3.0 MB 00:00 2024-09-11T08:09:11.656 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-11T08:09:11.681 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 863 kB/s | 245 kB 00:00 2024-09-11T08:09:11.706 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.9 MB/s | 250 kB 00:00 2024-09-11T08:09:11.807 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-11T08:09:12.115 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-11T08:09:12.116 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:12.117 INFO:teuthology.orchestra.run.smithi173.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-11T08:09:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 31/34 2024-09-11T08:09:12.318 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 31/34 2024-09-11T08:09:12.318 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:12.318 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T08:09:12.318 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T08:09:12.319 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T08:09:12.319 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:12.467 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:12.494 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:12.494 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:12.691 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 32/34 2024-09-11T08:09:12.715 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 32/34 2024-09-11T08:09:12.716 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:12.716 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T08:09:12.716 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T08:09:12.716 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T08:09:12.716 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:12.917 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 33/34 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 33/34 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T08:09:12.941 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:13.004 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 34/34 2024-09-11T08:09:13.009 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:13.009 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:13.785 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:13.864 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T08:09:13.914 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T08:09:14.024 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T08:09:14.065 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T08:09:14.251 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T08:09:14.281 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T08:09:14.366 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T08:09:14.671 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 34/34 2024-09-11T08:09:14.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/34 2024-09-11T08:09:14.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 3/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 4/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 5/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9. 6/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-11T08:09:14.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-11T08:09:14.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-11T08:09:14.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-11T08:09:15.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T08:09:15.152 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T08:09:15.633 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-11T08:09:15.633 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:15.633 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:15.633 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T08:09:15.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T08:09:15.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:15.636 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:16.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-base 2024-09-11T08:09:16.410 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T08:09:16.600 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:16.689 INFO:teuthology.orchestra.run.smithi175.stdout:Package ceph-base-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:16.730 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:16.731 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:09:16.731 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:16.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install cephadm 2024-09-11T08:09:17.354 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:17.451 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T08:09:17.471 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 12/12 2024-09-11T08:09:17.485 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 83 k 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:17.486 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:09:17.487 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:17.487 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 83 k 2024-09-11T08:09:17.487 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 375 k 2024-09-11T08:09:17.487 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:17.690 INFO:teuthology.orchestra.run.smithi175.stdout:cephadm-17.2.7-1623.gd0e6828a.el9.noarch.rpm 408 kB/s | 83 kB 00:00 2024-09-11T08:09:17.690 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:17.691 INFO:teuthology.orchestra.run.smithi175.stdout:Total 405 kB/s | 83 kB 00:00 2024-09-11T08:09:17.691 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:17.696 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:17.696 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:17.698 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:17.698 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:18.248 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:18.354 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:18.718 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:18.965 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:18.965 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:18.965 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:18.965 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:18.966 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:18.966 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:19.187 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T08:09:19.764 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:19.900 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repo Size 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 137 k 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:19.901 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:09:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:19.902 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 137 k 2024-09-11T08:09:19.902 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 379 k 2024-09-11T08:09:19.902 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:20.063 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 12/12 2024-09-11T08:09:20.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 1/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T08:09:20.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T08:09:20.106 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-immutable-object-cache-17.2.7-1623.gd0e682 672 kB/s | 137 kB 00:00 2024-09-11T08:09:20.106 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:20.107 INFO:teuthology.orchestra.run.smithi175.stdout:Total 667 kB/s | 137 kB 00:00 2024-09-11T08:09:20.107 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:20.114 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:20.114 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:20.171 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:20.172 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:20.320 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:20.382 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:20.407 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:20.407 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:20.407 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T08:09:20.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T08:09:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T08:09:20.451 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T08:09:20.451 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T08:09:20.451 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T08:09:20.451 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:20.452 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:20.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2024-09-11T08:09:21.399 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:10 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:21.417 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a. 1/1 2024-09-11T08:09:21.417 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:21.418 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:21.418 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:21.418 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:21.418 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:21.535 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:21.536 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:21.536 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:21.536 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:21.536 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:21.536 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 47 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T08:09:21.537 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2024-09-11T08:09:21.538 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:21.539 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.2 M 2024-09-11T08:09:21.539 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2024-09-11T08:09:21.539 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:21.644 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-mgr 2024-09-11T08:09:21.796 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 233 kB/s | 19 kB 00:00 2024-09-11T08:09:21.838 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 206 kB/s | 26 kB 00:00 2024-09-11T08:09:21.872 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): ceph-mgr-rook-17.2.7-1623.gd0e6828a.el9 300 kB/s | 47 kB 00:00 2024-09-11T08:09:21.897 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-11T08:09:21.955 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-11T08:09:21.981 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 641 kB/s | 54 kB 00:00 2024-09-11T08:09:22.022 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-11T08:09:22.056 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-11T08:09:22.081 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-11T08:09:22.115 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-11T08:09:22.140 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-11T08:09:22.165 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-11T08:09:22.199 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-11T08:09:22.202 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:22.202 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-11T08:09:22.223 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:22.265 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:22.280 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:22.281 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:22.313 INFO:teuthology.orchestra.run.smithi175.stdout:Package ceph-mgr-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:22.355 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:22.356 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:09:22.356 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:22.368 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:22.369 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:22.438 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T08:09:22.870 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:22.995 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:23.037 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T08:09:23.083 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 3.4 M 2024-09-11T08:09:23.129 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 24 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 15 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:Install 7 Packages 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 3.7 M 2024-09-11T08:09:23.130 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 80 M 2024-09-11T08:09:23.131 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:23.155 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T08:09:23.193 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T08:09:23.234 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T08:09:23.309 INFO:teuthology.orchestra.run.smithi175.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1623.gd0e 165 kB/s | 24 kB 00:00 2024-09-11T08:09:23.334 INFO:teuthology.orchestra.run.smithi175.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1623.gd0e6 84 kB/s | 15 kB 00:00 2024-09-11T08:09:23.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T08:09:23.376 INFO:teuthology.orchestra.run.smithi175.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-11T08:09:23.401 INFO:teuthology.orchestra.run.smithi175.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-11T08:09:23.426 INFO:teuthology.orchestra.run.smithi175.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 445 kB/s | 41 kB 00:00 2024-09-11T08:09:23.437 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T08:09:23.452 INFO:teuthology.orchestra.run.smithi175.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-11T08:09:23.485 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T08:09:23.560 INFO:teuthology.orchestra.run.smithi175.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1623.gd0e6828a 8.4 MB/s | 3.4 MB 00:00 2024-09-11T08:09:23.563 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:23.564 INFO:teuthology.orchestra.run.smithi175.stdout:Total 8.4 MB/s | 3.7 MB 00:00 2024-09-11T08:09:23.564 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:23.572 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:23.572 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:23.657 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:23.657 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:23.951 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:24.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-11T08:09:24.037 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-11T08:09:24.083 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-11T08:09:24.124 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-11T08:09:24.153 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.n 5/7 2024-09-11T08:09:24.193 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T08:09:24.250 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T08:09:24.292 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T08:09:24.337 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T08:09:24.361 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 13/13 2024-09-11T08:09:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9. 6/7 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 13/13 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 1/13 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T08:09:25.138 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T08:09:25.139 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T08:09:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 7/7 2024-09-11T08:09:25.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T08:09:25.475 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:25.476 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:25.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 7/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9. 1/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarc 2/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.n 3/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-11T08:09:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-11T08:09:26.312 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:15 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:26.446 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:26.446 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:26.446 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 124 k 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T08:09:26.447 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 7.0 M 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 33 M 2024-09-11T08:09:26.448 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:26.488 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-11T08:09:26.488 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:26.489 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:26.729 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T08:09:27.085 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1623.gd0e6828a.e 624 kB/s | 124 kB 00:00 2024-09-11T08:09:27.135 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T08:09:27.160 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-11T08:09:27.177 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 4.4 MB/s | 74 kB 00:00 2024-09-11T08:09:27.286 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:02 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:27.420 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 7.4 M 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T08:09:27.421 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout:Install 12 Packages 2024-09-11T08:09:27.422 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:27.423 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 38 M 2024-09-11T08:09:27.423 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 212 M 2024-09-11T08:09:27.423 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:27.519 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 392 kB/s | 248 kB 00:00 2024-09-11T08:09:27.902 INFO:teuthology.orchestra.run.smithi175.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-11T08:09:27.968 INFO:teuthology.orchestra.run.smithi175.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-11T08:09:27.994 INFO:teuthology.orchestra.run.smithi175.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-11T08:09:28.036 INFO:teuthology.orchestra.run.smithi175.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-11T08:09:28.086 INFO:teuthology.orchestra.run.smithi175.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-11T08:09:28.237 INFO:teuthology.orchestra.run.smithi175.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-11T08:09:28.303 INFO:teuthology.orchestra.run.smithi175.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-11T08:09:28.412 INFO:teuthology.orchestra.run.smithi175.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-11T08:09:28.477 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-11T08:09:28.479 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:28.480 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-09-11T08:09:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-09-11T08:09:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-11T08:09:28.551 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:(11/12): python3-devel-3.9.19-8.el9.x86_64.rpm 770 kB/s | 245 kB 00:00 2024-09-11T08:09:28.563 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:28.564 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:28.662 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:28.663 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:28.805 INFO:teuthology.orchestra.run.smithi175.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-11T08:09:28.806 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:28.806 INFO:teuthology.orchestra.run.smithi175.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-11T08:09:28.967 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:29.141 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T08:09:29.164 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:29.190 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:29.191 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:29.195 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T08:09:29.711 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:29.711 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:29.714 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T08:09:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T08:09:29.862 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T08:09:29.891 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 6/6 2024-09-11T08:09:30.470 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:30.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T08:09:30.594 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T08:09:30.666 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 6/6 2024-09-11T08:09:30.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/6 2024-09-11T08:09:30.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T08:09:30.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T08:09:30.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T08:09:30.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T08:09:30.694 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T08:09:30.729 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T08:09:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T08:09:30.928 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T08:09:30.928 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:30.928 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:30.928 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:30.929 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T08:09:31.028 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T08:09:31.173 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2024-09-11T08:09:31.683 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T08:09:31.734 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:20 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:31.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T08:09:31.868 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 813 k 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:31.869 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:31.870 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-09-11T08:09:31.870 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:31.870 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 893 k 2024-09-11T08:09:31.870 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.6 M 2024-09-11T08:09:31.870 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:32.013 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 670 kB/s | 80 kB 00:00 2024-09-11T08:09:32.180 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-17.2.7-1623.gd0e6828a.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-11T08:09:32.180 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:32.181 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.8 MB/s | 893 kB 00:00 2024-09-11T08:09:32.195 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:32.220 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:32.220 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:32.298 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:32.298 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:32.488 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:32.619 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T08:09:32.686 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/2 2024-09-11T08:09:33.051 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T08:09:33.348 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/2 2024-09-11T08:09:33.348 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/2 2024-09-11T08:09:33.621 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T08:09:33.621 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:33.622 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:33.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T08:09:33.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:33.622 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:33.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-volume 2024-09-11T08:09:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T08:09:34.118 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 12/12 2024-09-11T08:09:34.497 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:23 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:34.635 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:34.635 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 270 k 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 270 k 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.3 M 2024-09-11T08:09:34.636 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:34.875 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-volume-17.2.7-1623.gd0e6828a.el9.noarch.rp 1.1 MB/s | 270 kB 00:00 2024-09-11T08:09:34.876 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:34.876 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.1 MB/s | 270 kB 00:00 2024-09-11T08:09:34.876 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:34.884 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:34.884 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:34.913 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:34.914 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:35.130 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:35.194 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:35.210 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:35.210 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:35.210 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T08:09:35.210 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:36.211 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:36.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2024-09-11T08:09:36.650 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 12/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e68 1/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T08:09:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T08:09:37.040 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:37.041 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:37.055 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 126 k 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:37.191 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 126 k 2024-09-11T08:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 448 k 2024-09-11T08:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:37.397 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-17.2.7-1623.gd0e6828a.el9.x86_64 616 kB/s | 126 kB 00:00 2024-09-11T08:09:37.397 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:37.398 INFO:teuthology.orchestra.run.smithi173.stdout:Total 612 kB/s | 126 kB 00:00 2024-09-11T08:09:37.398 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:37.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-mgr-rook 2024-09-11T08:09:37.403 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:37.403 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:37.466 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:37.466 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:37.616 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:37.727 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:38.017 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:13 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:38.152 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:38.159 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 47 k 2024-09-11T08:09:38.160 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T08:09:38.161 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout:Install 13 Packages 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:38.162 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 2.2 M 2024-09-11T08:09:38.163 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 26 M 2024-09-11T08:09:38.163 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:38.411 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:38.411 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:38.412 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:38.412 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:38.412 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:38.412 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:38.618 INFO:teuthology.orchestra.run.smithi175.stdout:(1/13): ceph-mgr-rook-17.2.7-1623.gd0e6828a.el9 279 kB/s | 47 kB 00:00 2024-09-11T08:09:38.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2024-09-11T08:09:38.735 INFO:teuthology.orchestra.run.smithi175.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 89 kB/s | 26 kB 00:00 2024-09-11T08:09:38.760 INFO:teuthology.orchestra.run.smithi175.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 61 kB/s | 19 kB 00:00 2024-09-11T08:09:39.135 INFO:teuthology.orchestra.run.smithi175.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-11T08:09:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 410 kB/s | 222 kB 00:00 2024-09-11T08:09:39.211 INFO:teuthology.orchestra.run.smithi175.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 640 kB/s | 32 kB 00:00 2024-09-11T08:09:39.237 INFO:teuthology.orchestra.run.smithi175.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 586 kB/s | 279 kB 00:00 2024-09-11T08:09:39.253 INFO:teuthology.orchestra.run.smithi175.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 336 kB/s | 14 kB 00:00 2024-09-11T08:09:39.255 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:39.279 INFO:teuthology.orchestra.run.smithi175.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 375 kB/s | 54 kB 00:00 2024-09-11T08:09:39.321 INFO:teuthology.orchestra.run.smithi175.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-11T08:09:39.347 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:39.354 INFO:teuthology.orchestra.run.smithi175.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-11T08:09:39.380 INFO:teuthology.orchestra.run.smithi175.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-11T08:09:39.391 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:39.392 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:39.392 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:39.396 INFO:teuthology.orchestra.run.smithi175.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 512 kB/s | 59 kB 00:00 2024-09-11T08:09:39.399 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:39.399 INFO:teuthology.orchestra.run.smithi175.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-11T08:09:39.462 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:39.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2024-09-11T08:09:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:39.566 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:39.567 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:40.028 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:40.163 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:40.163 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 25 k 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 25 k 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 110 k 2024-09-11T08:09:40.164 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:40.225 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T08:09:40.280 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T08:09:40.308 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-17.2.7-1623.gd0e6828a.el9.x86_6 174 kB/s | 25 kB 00:00 2024-09-11T08:09:40.308 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:40.309 INFO:teuthology.orchestra.run.smithi173.stdout:Total 172 kB/s | 25 kB 00:00 2024-09-11T08:09:40.309 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:40.312 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:40.312 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:40.313 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:40.314 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:40.335 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T08:09:40.373 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T08:09:40.393 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T08:09:40.512 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:40.524 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T08:09:40.642 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T08:09:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T08:09:40.905 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:41.126 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:41.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2024-09-11T08:09:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T08:09:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T08:09:41.497 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T08:09:41.542 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T08:09:41.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 13/13 2024-09-11T08:09:41.864 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:41.954 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:41.997 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:41.998 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:41.998 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:42.071 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 13/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 1/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T08:09:42.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T08:09:42.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T08:09:42.630 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:42.686 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T08:09:42.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T08:09:42.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T08:09:42.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T08:09:42.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T08:09:42.688 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:42.688 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:42.723 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:42.765 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:42.766 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:42.766 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:42.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2024-09-11T08:09:42.942 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T08:09:43.404 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:43.493 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:43.505 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:18 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:43.536 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:43.537 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:43.537 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:43.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2024-09-11T08:09:43.638 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 124 k 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T08:09:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout:Install 6 Packages 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 7.0 M 2024-09-11T08:09:43.640 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 33 M 2024-09-11T08:09:43.641 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:43.914 INFO:teuthology.orchestra.run.smithi175.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1623.gd0e6828a.e 631 kB/s | 124 kB 00:00 2024-09-11T08:09:43.948 INFO:teuthology.orchestra.run.smithi175.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-11T08:09:43.998 INFO:teuthology.orchestra.run.smithi175.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-11T08:09:44.023 INFO:teuthology.orchestra.run.smithi175.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 767 kB/s | 58 kB 00:00 2024-09-11T08:09:44.048 INFO:teuthology.orchestra.run.smithi175.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-11T08:09:44.162 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:44.251 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:44.293 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:44.294 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:44.294 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:44.363 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2024-09-11T08:09:44.917 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:45.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2024-09-11T08:09:45.332 INFO:teuthology.orchestra.run.smithi175.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-11T08:09:45.334 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:45.334 INFO:teuthology.orchestra.run.smithi175.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-09-11T08:09:45.408 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:45.419 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:45.419 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:45.519 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:45.519 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:45.693 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:45.784 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:45.827 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:45.828 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-09-11T08:09:45.828 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:45.832 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:45.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2024-09-11T08:09:46.004 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T08:09:46.050 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T08:09:46.457 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:46.569 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T08:09:46.590 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:46.590 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 82 k 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:46.591 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:46.592 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:46.592 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:46.592 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:46.593 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 82 k 2024-09-11T08:09:46.593 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 222 k 2024-09-11T08:09:46.593 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:46.653 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T08:09:46.708 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T08:09:46.737 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 6/6 2024-09-11T08:09:46.803 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 388 kB/s | 82 kB 00:00 2024-09-11T08:09:46.803 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:46.804 INFO:teuthology.orchestra.run.smithi173.stdout:Total 386 kB/s | 82 kB 00:00 2024-09-11T08:09:46.804 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:46.810 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:46.810 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:46.874 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:46.874 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:47.018 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:47.124 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:47.475 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:47.539 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 6/6 2024-09-11T08:09:47.540 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 1/6 2024-09-11T08:09:47.540 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T08:09:47.540 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T08:09:47.540 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T08:09:47.540 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T08:09:47.743 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:47.744 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:47.744 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:47.744 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:47.744 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:47.744 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T08:09:47.818 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T08:09:47.819 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:47.819 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:47.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2024-09-11T08:09:48.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-fuse 2024-09-11T08:09:48.559 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:48.657 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:23 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:48.697 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:48.697 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:48.697 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.9 M 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.9 M 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 12 M 2024-09-11T08:09:48.698 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:48.796 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 813 k 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout:Install 2 Packages 2024-09-11T08:09:48.797 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:48.798 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 893 k 2024-09-11T08:09:48.798 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 2.6 M 2024-09-11T08:09:48.798 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:49.031 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 8.8 MB/s | 2.9 MB 00:00 2024-09-11T08:09:49.031 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:49.032 INFO:teuthology.orchestra.run.smithi173.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-11T08:09:49.032 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:49.040 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:49.041 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:49.119 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:49.120 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:49.267 INFO:teuthology.orchestra.run.smithi175.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 417 kB/s | 80 kB 00:00 2024-09-11T08:09:49.341 INFO:teuthology.orchestra.run.smithi175.stdout:(2/2): ceph-fuse-17.2.7-1623.gd0e6828a.el9.x86_ 3.0 MB/s | 813 kB 00:00 2024-09-11T08:09:49.342 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:49.342 INFO:teuthology.orchestra.run.smithi175.stdout:Total 1.6 MB/s | 893 kB 00:00 2024-09-11T08:09:49.354 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:49.376 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:49.376 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:49.460 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:49.460 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:49.528 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:49.590 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:49.615 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:49.615 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:49.615 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T08:09:49.615 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T08:09:49.616 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T08:09:49.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:49.662 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:49.807 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T08:09:49.875 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/2 2024-09-11T08:09:50.606 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2/2 2024-09-11T08:09:50.607 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/2 2024-09-11T08:09:50.676 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:50.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:50.677 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:50.677 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:50.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:50.677 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T08:09:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:50.861 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:50.861 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T08:09:50.862 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:50.862 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:50.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2024-09-11T08:09:51.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-volume 2024-09-11T08:09:51.495 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 08:08:11 AM UTC. 2024-09-11T08:09:51.629 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 165 k 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-09-11T08:09:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:51.631 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 165 k 2024-09-11T08:09:51.631 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 477 k 2024-09-11T08:09:51.631 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-11T08:09:51.736 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:51.842 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 782 kB/s | 165 kB 00:00 2024-09-11T08:09:51.843 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:51.843 INFO:teuthology.orchestra.run.smithi173.stdout:Total 775 kB/s | 165 kB 00:00 2024-09-11T08:09:51.843 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-11T08:09:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-11T08:09:51.851 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-11T08:09:51.872 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:17.2.7-1623.gd0e6828a.el9 ceph-noarch 270 k 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:09:51.873 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:51.874 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 270 k 2024-09-11T08:09:51.874 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 1.3 M 2024-09-11T08:09:51.874 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:51.915 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-11T08:09:51.915 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-11T08:09:52.070 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-11T08:09:52.080 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-volume-17.2.7-1623.gd0e6828a.el9.noarch.rp 1.3 MB/s | 270 kB 00:00 2024-09-11T08:09:52.080 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:52.081 INFO:teuthology.orchestra.run.smithi175.stdout:Total 1.3 MB/s | 270 kB 00:00 2024-09-11T08:09:52.081 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:52.089 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:52.089 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:52.117 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:52.117 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:52.326 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:52.398 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:52.415 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:09:52.415 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T08:09:52.415 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:52.605 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:09:52.851 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-11T08:09:53.087 DEBUG:teuthology.parallel:result is None 2024-09-11T08:09:53.392 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 1/1 2024-09-11T08:09:53.392 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:53.392 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:53.393 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:17.2.7-1623.gd0e6828a.el9.noarch 2024-09-11T08:09:53.393 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:53.393 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:53.676 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install librados-devel 2024-09-11T08:09:54.249 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:54.387 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:54.387 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:54.387 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repo Size 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 126 k 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 126 k 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 448 k 2024-09-11T08:09:54.388 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:54.568 INFO:teuthology.orchestra.run.smithi175.stdout:librados-devel-17.2.7-1623.gd0e6828a.el9.x86_64 705 kB/s | 126 kB 00:00 2024-09-11T08:09:54.569 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:54.569 INFO:teuthology.orchestra.run.smithi175.stdout:Total 698 kB/s | 126 kB 00:00 2024-09-11T08:09:54.569 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:54.574 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:54.574 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:54.637 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:54.637 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:54.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:55.369 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:55.617 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:55.617 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:55.617 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:55.618 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:55.618 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:55.618 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:55.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install libcephfs2 2024-09-11T08:09:56.468 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:56.560 INFO:teuthology.orchestra.run.smithi175.stdout:Package libcephfs2-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:56.603 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:56.604 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:09:56.604 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:56.697 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install libcephfs-devel 2024-09-11T08:09:57.257 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:57.391 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:57.391 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repo Size 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 25 k 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 25 k 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 110 k 2024-09-11T08:09:57.392 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:09:57.538 INFO:teuthology.orchestra.run.smithi175.stdout:libcephfs-devel-17.2.7-1623.gd0e6828a.el9.x86_6 171 kB/s | 25 kB 00:00 2024-09-11T08:09:57.538 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:09:57.539 INFO:teuthology.orchestra.run.smithi175.stdout:Total 170 kB/s | 25 kB 00:00 2024-09-11T08:09:57.539 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:09:57.542 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:09:57.542 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:09:57.544 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:09:57.544 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:09:57.626 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:09:57.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:58.109 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:58.340 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:09:58.341 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:58.341 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:09:58.341 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:09:58.341 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:09:58.341 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:58.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install librados2 2024-09-11T08:09:59.109 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:59.198 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:09:59.241 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:09:59.241 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:09:59.241 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:09:59.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install librbd1 2024-09-11T08:09:59.875 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:09:59.965 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:10:00.007 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:00.008 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:10:00.009 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:00.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install python3-rados 2024-09-11T08:10:00.679 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:00.768 INFO:teuthology.orchestra.run.smithi175.stdout:Package python3-rados-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:10:00.809 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:00.810 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:10:00.810 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:00.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install python3-rgw 2024-09-11T08:10:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:36 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:01.529 INFO:teuthology.orchestra.run.smithi175.stdout:Package python3-rgw-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:10:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:10:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:01.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install python3-cephfs 2024-09-11T08:10:02.220 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:02.312 INFO:teuthology.orchestra.run.smithi175.stdout:Package python3-cephfs-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:10:02.354 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:02.355 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:10:02.355 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:02.446 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install python3-rbd 2024-09-11T08:10:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:Package python3-rbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 is already installed. 2024-09-11T08:10:03.136 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:03.137 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T08:10:03.137 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:03.218 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install rbd-fuse 2024-09-11T08:10:03.800 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:03.933 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 82 k 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:03.934 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:10:03.935 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:03.935 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 82 k 2024-09-11T08:10:03.935 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 222 k 2024-09-11T08:10:03.935 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:10:04.133 INFO:teuthology.orchestra.run.smithi175.stdout:rbd-fuse-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 413 kB/s | 82 kB 00:00 2024-09-11T08:10:04.134 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:10:04.134 INFO:teuthology.orchestra.run.smithi175.stdout:Total 411 kB/s | 82 kB 00:00 2024-09-11T08:10:04.134 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:10:04.140 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:10:04.140 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:10:04.204 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:10:04.204 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:10:04.349 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:10:04.455 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:04.846 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:05.107 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:05.108 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:05.108 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:10:05.108 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:10:05.108 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:05.108 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:05.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install rbd-mirror 2024-09-11T08:10:05.938 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:06.076 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:06.076 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:06.076 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repo Size 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 2.9 M 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 2.9 M 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 12 M 2024-09-11T08:10:06.077 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:10:06.445 INFO:teuthology.orchestra.run.smithi175.stdout:rbd-mirror-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 8.0 MB/s | 2.9 MB 00:00 2024-09-11T08:10:06.445 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:10:06.446 INFO:teuthology.orchestra.run.smithi175.stdout:Total 8.0 MB/s | 2.9 MB 00:00 2024-09-11T08:10:06.446 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:10:06.455 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:10:06.455 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:10:06.535 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:10:06.535 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:10:06.952 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:10:07.004 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:07.029 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:07.029 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T08:10:07.029 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T08:10:07.029 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T08:10:07.030 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T08:10:07.030 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:08.332 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:08.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install rbd-nbd 2024-09-11T08:10:09.179 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 08:08:25 AM UTC. 2024-09-11T08:10:09.314 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:17.2.7-1623.gd0e6828a.el9 ceph 165 k 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:Install 1 Package 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 165 k 2024-09-11T08:10:09.315 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 477 k 2024-09-11T08:10:09.316 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T08:10:09.516 INFO:teuthology.orchestra.run.smithi175.stdout:rbd-nbd-17.2.7-1623.gd0e6828a.el9.x86_64.rpm 824 kB/s | 165 kB 00:00 2024-09-11T08:10:09.517 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:10:09.517 INFO:teuthology.orchestra.run.smithi175.stdout:Total 818 kB/s | 165 kB 00:00 2024-09-11T08:10:09.517 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T08:10:09.525 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T08:10:09.525 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T08:10:09.588 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T08:10:09.588 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T08:10:09.741 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T08:10:09.847 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:10.282 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 1/1 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:17.2.7-1623.gd0e6828a.el9.x86_64 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:10:10.531 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T08:10:10.830 DEBUG:teuthology.parallel:result is None 2024-09-11T08:10:10.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:10:10.977 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T08:10:11.003 INFO:teuthology.orchestra.run.smithi173.stdout:17.2.7-1623.gd0e6828a.el9 2024-09-11T08:10:11.004 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1623.gd0e6828a.el9 2024-09-11T08:10:11.004 INFO:teuthology.task.install:The correct ceph version 17.2.7-1623.gd0e6828a is installed. 2024-09-11T08:10:11.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:10:11.147 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T08:10:11.169 INFO:teuthology.orchestra.run.smithi175.stdout:17.2.7-1623.gd0e6828a.el9 2024-09-11T08:10:11.169 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1623.gd0e6828a.el9 2024-09-11T08:10:11.169 INFO:teuthology.task.install:The correct ceph version 17.2.7-1623.gd0e6828a is installed. 2024-09-11T08:10:11.171 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T08:10:11.171 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:10:11.172 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T08:10:11.203 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:10:11.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T08:10:11.236 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T08:10:11.236 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:10:11.236 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T08:10:11.272 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T08:10:11.340 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:10:11.340 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T08:10:11.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T08:10:11.431 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T08:10:11.432 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:10:11.432 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T08:10:11.459 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T08:10:11.526 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:10:11.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T08:10:11.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T08:10:11.616 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T08:10:11.616 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:10:11.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T08:10:11.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T08:10:11.708 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:10:11.708 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T08:10:11.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T08:10:11.797 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T08:10:11.886 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'd0e6828a2016d48cf25ad84064e50742bb1c39b9', 'cephadm_mode': 'root'} 2024-09-11T08:10:11.886 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:10:11.887 INFO:tasks.cephadm:Cluster fsid is 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:10:11.887 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T08:10:11.887 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.173', 'mon.c': '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]', 'mon.b': '172.21.15.175'} 2024-09-11T08:10:11.887 INFO:tasks.cephadm:First mon is mon.a on smithi173 2024-09-11T08:10:11.887 INFO:tasks.cephadm:First mgr is y 2024-09-11T08:10:11.887 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T08:10:11.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-09-11T08:10:11.914 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-09-11T08:10:11.939 INFO:tasks.cephadm:Downloading cephadm (repo https://git.ceph.com/ceph-ci.git ref d0e6828a2016d48cf25ad84064e50742bb1c39b9)... 2024-09-11T08:10:11.940 DEBUG:teuthology.orchestra.run.smithi173:> git clone https://git.ceph.com/ceph-ci.git testrepo && cd testrepo && git show d0e6828a2016d48cf25ad84064e50742bb1c39b9:src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T08:10:11.970 INFO:teuthology.orchestra.run.smithi173.stderr:Cloning into 'testrepo'... 2024-09-11T08:11:09.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 11 08:11 /home/ubuntu/cephtest/cephadm 2024-09-11T08:11:09.522 DEBUG:teuthology.orchestra.run.smithi175:> git clone https://git.ceph.com/ceph-ci.git testrepo && cd testrepo && git show d0e6828a2016d48cf25ad84064e50742bb1c39b9:src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T08:11:09.541 INFO:teuthology.orchestra.run.smithi175.stderr:Cloning into 'testrepo'... 2024-09-11T08:12:07.065 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 11 08:12 /home/ubuntu/cephtest/cephadm 2024-09-11T08:12:07.066 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T08:12:07.086 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T08:12:07.135 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 on all hosts... 2024-09-11T08:12:07.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 pull 2024-09-11T08:12:07.138 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 pull 2024-09-11T08:12:08.800 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9... 2024-09-11T08:12:10.768 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9... 2024-09-11T08:12:35.818 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-11T08:12:35.818 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable)", 2024-09-11T08:12:35.818 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b", 2024-09-11T08:12:35.818 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-09-11T08:12:35.819 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40" 2024-09-11T08:12:35.819 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-11T08:12:35.819 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-11T08:12:39.603 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-11T08:12:39.603 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable)", 2024-09-11T08:12:39.604 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b", 2024-09-11T08:12:39.604 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-09-11T08:12:39.604 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40" 2024-09-11T08:12:39.604 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-09-11T08:12:39.604 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-11T08:12:39.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-09-11T08:12:39.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-09-11T08:12:39.681 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-09-11T08:12:39.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-09-11T08:12:39.748 INFO:tasks.cephadm:Writing seed config... 2024-09-11T08:12:39.749 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T08:12:39.749 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T08:12:39.749 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T08:12:39.749 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-11T08:12:39.750 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T08:12:39.751 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:12:39.751 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T08:12:39.781 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4492cbfa-7015-11ef-bcea-c7b262605968 mon election default strategy = 3 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-11T08:12:39.782 DEBUG:teuthology.orchestra.run.smithi173:mon.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T08:12:39.824 DEBUG:teuthology.orchestra.run.smithi173:mgr.y> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T08:12:39.869 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T08:12:39.869 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 -v bootstrap --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.173 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:12:40.074 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-11T08:12:40.074 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9', '-v', 'bootstrap', '--fsid', '4492cbfa-7015-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.173', '--skip-admin-label'] 2024-09-11T08:12:40.099 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stdout 5.2.2 2024-09-11T08:12:40.100 INFO:teuthology.orchestra.run.smithi173.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T08:12:40.100 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying podman|docker is present... 2024-09-11T08:12:40.123 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stdout 5.2.2 2024-09-11T08:12:40.123 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying lvm2 is present... 2024-09-11T08:12:40.123 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying time synchronization is in place... 2024-09-11T08:12:40.131 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T08:12:40.131 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T08:12:40.138 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T08:12:40.138 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:12:40.146 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout enabled 2024-09-11T08:12:40.153 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout active 2024-09-11T08:12:40.153 INFO:teuthology.orchestra.run.smithi173.stdout:Unit chronyd.service is enabled and running 2024-09-11T08:12:40.153 INFO:teuthology.orchestra.run.smithi173.stdout:Repeating the final host check... 2024-09-11T08:12:40.177 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stdout 5.2.2 2024-09-11T08:12:40.177 INFO:teuthology.orchestra.run.smithi173.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T08:12:40.177 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl is present 2024-09-11T08:12:40.177 INFO:teuthology.orchestra.run.smithi173.stdout:lvcreate is present 2024-09-11T08:12:40.184 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T08:12:40.184 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T08:12:40.190 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T08:12:40.190 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:12:40.198 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout enabled 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout active 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Unit chronyd.service is enabled and running 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Host looks OK 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Cluster fsid: 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Acquiring lock 140189018690464 on /run/cephadm/4492cbfa-7015-11ef-bcea-c7b262605968.lock 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Lock 140189018690464 acquired on /run/cephadm/4492cbfa-7015-11ef-bcea-c7b262605968.lock 2024-09-11T08:12:40.205 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying IP 172.21.15.173 port 3300 ... 2024-09-11T08:12:40.206 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying IP 172.21.15.173 port 6789 ... 2024-09-11T08:12:40.206 INFO:teuthology.orchestra.run.smithi173.stdout:Base mon IP(s) is [172.21.15.173:3300, 172.21.15.173:6789], mon addrv is [v2:172.21.15.173:3300,v1:172.21.15.173:6789] 2024-09-11T08:12:40.209 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.173 metric 100 2024-09-11T08:12:40.209 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.173 metric 100 2024-09-11T08:12:40.213 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T08:12:40.213 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-11T08:12:40.213 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7259/64 scope link noprefixroute 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:Mon IP `172.21.15.173` is in CIDR network `172.21.0.0/20` 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:Mon IP `172.21.15.173` is in CIDR network `172.21.0.0/20` 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T08:12:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T08:12:40.217 INFO:teuthology.orchestra.run.smithi173.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9... 2024-09-11T08:12:40.727 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stdout 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b 2024-09-11T08:12:40.727 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9... 2024-09-11T08:12:40.727 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T08:12:40.727 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Copying blob sha256:0d2f264d63cec2f6fb0f85eed7b2c8c5b4db3ab9edd9d71a74c04647294a553f 2024-09-11T08:12:40.727 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T08:12:40.728 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Copying config sha256:4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b 2024-09-11T08:12:40.728 INFO:teuthology.orchestra.run.smithi173.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T08:12:41.715 INFO:teuthology.orchestra.run.smithi173.stdout:ceph: stdout ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable) 2024-09-11T08:12:41.715 INFO:teuthology.orchestra.run.smithi173.stdout:Ceph version: ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable) 2024-09-11T08:12:41.716 INFO:teuthology.orchestra.run.smithi173.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T08:12:42.605 INFO:teuthology.orchestra.run.smithi173.stdout:stat: stdout 167 167 2024-09-11T08:12:42.605 INFO:teuthology.orchestra.run.smithi173.stdout:Creating initial keys... 2024-09-11T08:12:43.460 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph-authtool: stdout AQD6UOFmmlRTNhAA+5aqrkdI1XRXriFSSA0Ruw== 2024-09-11T08:12:44.542 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph-authtool: stdout AQD7UOFmZCZXMBAAuYjMbBD00/s8XTikHYlYeQ== 2024-09-11T08:12:45.573 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph-authtool: stdout AQD8UOFmSf4QNBAAnz7rdv4jlcSB1H8V9YpGWA== 2024-09-11T08:12:45.574 INFO:teuthology.orchestra.run.smithi173.stdout:Creating initial monmap... 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool for a [v2:172.21.15.173:3300,v1:172.21.15.173:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:setting min_mon_release = octopus 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: set fsid to 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:12:46.489 INFO:teuthology.orchestra.run.smithi173.stdout:Creating mon... 2024-09-11T08:12:47.445 INFO:teuthology.orchestra.run.smithi173.stdout:create mon.a on 2024-09-11T08:12:47.650 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T08:12:47.797 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T08:12:47.951 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target. 2024-09-11T08:12:47.952 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target. 2024-09-11T08:12:48.133 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a 2024-09-11T08:12:48.134 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T08:12:48.291 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target.wants/ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968@.service. 2024-09-11T08:12:48.813 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:48 smithi173 ceph-mon[29197]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T08:12:48.826 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T08:12:48.826 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout disabled 2024-09-11T08:12:48.833 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T08:12:48.834 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:12:48.834 INFO:teuthology.orchestra.run.smithi173.stdout:firewalld.service is not enabled 2024-09-11T08:12:48.834 INFO:teuthology.orchestra.run.smithi173.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T08:12:48.834 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mon to start... 2024-09-11T08:12:48.835 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mon... 2024-09-11T08:12:49.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:48 smithi173 bash[29159]: 32ac2809092143aed74bef75b6ec4b299a7e3c15d5a30d690d0a6ae463758bea 2024-09-11T08:12:49.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:48 smithi173 systemd[1]: Started Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: monmap e1: 1 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: fsmap 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: mgrmap e1: no daemons active 2024-09-11T08:12:49.846 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:49 smithi173 ceph-mon[29197]: from='client.? 172.21.15.173:0/1011054295' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T08:12:49.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout id: 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout services: 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.533227s) 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T08:12:49.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout data: 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.209+0000 7f43b8ca3640 1 Processor -- start 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.209+0000 7f43b8ca3640 1 -- start start 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.209+0000 7f43b8ca3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.209+0000 7f43b8ca3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40ff2b0 con 0x7f43b40fe960 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.210+0000 7f43b259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.210+0000 7f43b259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47058/0 (socket says 172.21.15.173:47058) 2024-09-11T08:12:49.855 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.210+0000 7f43b259c640 1 -- 172.21.15.173:0/1942532501 learned_addr learned my addr 172.21.15.173:0/1942532501 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.210+0000 7f43b259c640 1 -- 172.21.15.173:0/1942532501 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40ff3f0 con 0x7f43b40fe960 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.212+0000 7f43b259c640 1 --2- 172.21.15.173:0/1942532501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009840 tx=0x7f43a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9ff8de76988f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.212+0000 7f43b159a640 1 -- 172.21.15.173:0/1942532501 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a402add0 con 0x7f43b40fe960 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.212+0000 7f43b159a640 1 -- 172.21.15.173:0/1942532501 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4032440 con 0x7f43b40fe960 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.212+0000 7f43b159a640 1 -- 172.21.15.173:0/1942532501 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a4032750 con 0x7f43b40fe960 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1942532501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 msgr2=0x7f43b40fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 --2- 172.21.15.173:0/1942532501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009840 tx=0x7f43a40091d0 comp rx=0 tx=0).stop 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1942532501 shutdown_connections 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 --2- 172.21.15.173:0/1942532501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b40fed70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1942532501 >> 172.21.15.173:0/1942532501 conn(0x7f43b40fa180 msgr2=0x7f43b40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1942532501 shutdown_connections 2024-09-11T08:12:49.856 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1942532501 wait complete. 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 Processor -- start 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- start start 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.213+0000 7f43b8ca3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b410dc70 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47060/0 (socket says 172.21.15.173:47060) 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b259c640 1 -- 172.21.15.173:0/1011054295 learned_addr learned my addr 172.21.15.173:0/1011054295 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b259c640 1 -- 172.21.15.173:0/1011054295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009450 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b259c640 1 --2- 172.21.15.173:0/1011054295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f43a402a700 tx=0x7f43a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a4031a80 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4031be0 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a403b400 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b410de70 con 0x7f43b40fe960 2024-09-11T08:12:49.857 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.214+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b410e220 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.215+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f43a4039040 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.215+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f43a4041030 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.215+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b405ed70 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.217+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f43a4037070 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.274+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f43b410ea00 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43a2ffd640 1 -- 172.21.15.173:0/1011054295 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f43a403b980 con 0x7f43b40fe960 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 msgr2=0x7f43b410d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 --2- 172.21.15.173:0/1011054295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f43a402a700 tx=0x7f43a4032000 comp rx=0 tx=0).stop 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 shutdown_connections 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 --2- 172.21.15.173:0/1011054295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43b40fe960 0x7f43b410d730 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 >> 172.21.15.173:0/1011054295 conn(0x7f43b40fa180 msgr2=0x7f43b4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 shutdown_connections 2024-09-11T08:12:49.858 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:49.275+0000 7f43b8ca3640 1 -- 172.21.15.173:0/1011054295 wait complete. 2024-09-11T08:12:49.859 INFO:teuthology.orchestra.run.smithi173.stdout:mon is available 2024-09-11T08:12:49.859 INFO:teuthology.orchestra.run.smithi173.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T08:12:50.911 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:50 smithi173 ceph-mon[29197]: from='client.? 172.21.15.173:0/890571101' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T08:12:50.911 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:50 smithi173 ceph-mon[29197]: from='client.? 172.21.15.173:0/890571101' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T08:12:50.920 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:50.920 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T08:12:50.920 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout fsid = 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.173:3300,v1:172.21.15.173:6789] 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T08:12:50.921 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.264+0000 7fc3fb9fb640 1 Processor -- start 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.264+0000 7fc3fb9fb640 1 -- start start 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.264+0000 7fc3fb9fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.264+0000 7fc3fb9fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4076930 con 0x7fc3f4076520 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.265+0000 7fc3f9797640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.265+0000 7fc3f9797640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47064/0 (socket says 172.21.15.173:47064) 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.265+0000 7fc3f9797640 1 -- 172.21.15.173:0/2765788381 learned_addr learned my addr 172.21.15.173:0/2765788381 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.265+0000 7fc3f9797640 1 -- 172.21.15.173:0/2765788381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4074fe0 con 0x7fc3f4076520 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.265+0000 7fc3f9797640 1 --2- 172.21.15.173:0/2765788381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009e50 tx=0x7fc3e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fceae966d15b0257 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3f3fff640 1 -- 172.21.15.173:0/2765788381 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e4031400 con 0x7fc3f4076520 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3f3fff640 1 -- 172.21.15.173:0/2765788381 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e402d050 con 0x7fc3f4076520 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3f3fff640 1 -- 172.21.15.173:0/2765788381 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e40315c0 con 0x7fc3f4076520 2024-09-11T08:12:50.922 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/2765788381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 msgr2=0x7fc3f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 --2- 172.21.15.173:0/2765788381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009e50 tx=0x7fc3e4009840 comp rx=0 tx=0).stop 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/2765788381 shutdown_connections 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 --2- 172.21.15.173:0/2765788381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4074aa0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/2765788381 >> 172.21.15.173:0/2765788381 conn(0x7fc3f40fbb50 msgr2=0x7fc3f40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/2765788381 shutdown_connections 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.266+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/2765788381 wait complete. 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3fb9fb640 1 Processor -- start 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3fb9fb640 1 -- start start 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3fb9fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3fb9fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f41111a0 con 0x7fc3f4076520 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3f9797640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3f9797640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47078/0 (socket says 172.21.15.173:47078) 2024-09-11T08:12:50.923 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3f9797640 1 -- 172.21.15.173:0/890571101 learned_addr learned my addr 172.21.15.173:0/890571101 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.267+0000 7fc3f9797640 1 -- 172.21.15.173:0/890571101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009ae0 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f9797640 1 --2- 172.21.15.173:0/890571101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc3e402abe0 tx=0x7fc3e4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e4031e00 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4007a10 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3e4007bc0 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f41113a0 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4111f30 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc3e4038070 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.268+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc3e4045a20 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.269+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4111870 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.271+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc3f4111870 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.326+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc3f405ed70 con 0x7fc3f4076520 2024-09-11T08:12:50.924 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.329+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 7 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fc3e4007d20 con 0x7fc3f4076520 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.329+0000 7fc3f1ffb640 1 -- 172.21.15.173:0/890571101 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+376 (secure 0 0 0) 0x7fc3e4040070 con 0x7fc3f4076520 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 msgr2=0x7fc3f4110c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 --2- 172.21.15.173:0/890571101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc3e402abe0 tx=0x7fc3e4036000 comp rx=0 tx=0).stop 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 shutdown_connections 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 --2- 172.21.15.173:0/890571101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3f4076520 0x7fc3f4110c60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 >> 172.21.15.173:0/890571101 conn(0x7fc3f40fbb50 msgr2=0x7fc3f41078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 shutdown_connections 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:50.330+0000 7fc3fb9fb640 1 -- 172.21.15.173:0/890571101 wait complete. 2024-09-11T08:12:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:Generating new minimal ceph.conf... 2024-09-11T08:12:52.018 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:51 smithi173 ceph-mon[29197]: from='client.? 172.21.15.173:0/4274976495' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.330+0000 7f5d08105640 1 Processor -- start 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.330+0000 7f5d08105640 1 -- start start 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d08105640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d08105640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00100c40 con 0x7f5d001002f0 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d05ea1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d05ea1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47094/0 (socket says 172.21.15.173:47094) 2024-09-11T08:12:52.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d05ea1640 1 -- 172.21.15.173:0/3837120018 learned_addr learned my addr 172.21.15.173:0/3837120018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.331+0000 7f5d05ea1640 1 -- 172.21.15.173:0/3837120018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00100d80 con 0x7f5d001002f0 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d05ea1640 1 --2- 172.21.15.173:0/3837120018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009840 tx=0x7f5cfc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c354dc046320fe01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d04e9f640 1 -- 172.21.15.173:0/3837120018 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc02add0 con 0x7f5d001002f0 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d04e9f640 1 -- 172.21.15.173:0/3837120018 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f5cfc032860 con 0x7f5d001002f0 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d04e9f640 1 -- 172.21.15.173:0/3837120018 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc031630 con 0x7f5d001002f0 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d08105640 1 -- 172.21.15.173:0/3837120018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 msgr2=0x7f5d00100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.332+0000 7f5d08105640 1 --2- 172.21.15.173:0/3837120018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009840 tx=0x7f5cfc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- 172.21.15.173:0/3837120018 shutdown_connections 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 --2- 172.21.15.173:0/3837120018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00100700 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- 172.21.15.173:0/3837120018 >> 172.21.15.173:0/3837120018 conn(0x7f5d000fbb30 msgr2=0x7f5d000fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- 172.21.15.173:0/3837120018 shutdown_connections 2024-09-11T08:12:52.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- 172.21.15.173:0/3837120018 wait complete. 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 Processor -- start 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- start start 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d08105640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000769d0 con 0x7f5d001002f0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d05ea1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d05ea1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47102/0 (socket says 172.21.15.173:47102) 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.333+0000 7f5d05ea1640 1 -- 172.21.15.173:0/4274976495 learned_addr learned my addr 172.21.15.173:0/4274976495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5d05ea1640 1 -- 172.21.15.173:0/4274976495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009450 con 0x7f5d001002f0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5d05ea1640 1 --2- 172.21.15.173:0/4274976495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc006a70 tx=0x7f5cfc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc031dd0 con 0x7f5d001002f0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f5cfc03b860 con 0x7f5d001002f0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d00074a60 con 0x7f5d001002f0 2024-09-11T08:12:52.027 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc03a3a0 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d00074ed0 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5cfc039070 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.334+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5cfc03ace0 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.335+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0005ed70 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.337+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5cfc049060 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.393+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5d00102050 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.393+0000 7f5cf67fc640 1 -- 172.21.15.173:0/4274976495 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f5cfc03f070 con 0x7f5d001002f0 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 msgr2=0x7f5d00076490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 --2- 172.21.15.173:0/4274976495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc006a70 tx=0x7f5cfc02c040 comp rx=0 tx=0).stop 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 shutdown_connections 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 --2- 172.21.15.173:0/4274976495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d001002f0 0x7f5d00076490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:52.028 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 >> 172.21.15.173:0/4274976495 conn(0x7f5d000fbb30 msgr2=0x7f5d000fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:52.029 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 shutdown_connections 2024-09-11T08:12:52.029 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:51.394+0000 7f5d08105640 1 -- 172.21.15.173:0/4274976495 wait complete. 2024-09-11T08:12:52.029 INFO:teuthology.orchestra.run.smithi173.stdout:Restarting the monitor... 2024-09-11T08:12:52.299 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 systemd[1]: Stopping Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:12:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a[29174]: 2024-09-11T08:12:52.297+0000 7f24bfee5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:12:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a[29174]: 2024-09-11T08:12:52.297+0000 7f24bfee5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T08:12:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 podman[29514]: 2024-09-11 08:12:52.522631695 +0000 UTC m=+0.338537602 container died 32ac2809092143aed74bef75b6ec4b299a7e3c15d5a30d690d0a6ae463758bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2) 2024-09-11T08:12:53.199 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 podman[29514]: 2024-09-11 08:12:52.854425428 +0000 UTC m=+0.670331324 container cleanup 32ac2809092143aed74bef75b6ec4b299a7e3c15d5a30d690d0a6ae463758bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:12:53.200 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 bash[29514]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a 2024-09-11T08:12:53.200 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:52 smithi173 podman[29532]: 2024-09-11 08:12:52.997269748 +0000 UTC m=+0.471219945 container remove 32ac2809092143aed74bef75b6ec4b299a7e3c15d5a30d690d0a6ae463758bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T08:12:53.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T08:12:53.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 systemd[1]: Stopped Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:12:53.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 systemd[1]: Starting Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:12:53.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 podman[29626]: 2024-09-11 08:12:53.326286201 +0000 UTC m=+0.019645447 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:12:53.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 podman[29626]: 2024-09-11 08:12:53.431394656 +0000 UTC m=+0.124753904 container create e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T08:12:53.757 INFO:teuthology.orchestra.run.smithi173.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T08:12:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 podman[29626]: 2024-09-11 08:12:53.662618112 +0000 UTC m=+0.355977358 container init e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:12:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 podman[29626]: 2024-09-11 08:12:53.667123395 +0000 UTC m=+0.360482642 container start e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T08:12:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T08:12:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable), process ceph-mon, pid 7 2024-09-11T08:12:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: pidfile_write: ignore empty --pid-file 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: load: jerasure load: lrc 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: RocksDB version: 6.15.5 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Compile date Sep 10 2024 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: DB SUMMARY 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: DB Session ID: ZCQVGW539OLG3WBKNBGN 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: CURRENT file: CURRENT 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 85070 ; 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.error_if_exists: 0 2024-09-11T08:12:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.create_if_missing: 0 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.paranoid_checks: 1 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.env: 0x5556ade1d440 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.fs: Posix File System 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.info_log: 0x5556ae958ec0 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.statistics: (nil) 2024-09-11T08:12:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.use_fsync: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_log_file_size: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_fallocate: 1 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T08:12:53.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.use_direct_reads: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.db_log_dir: 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T08:12:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.write_buffer_manager: 0x5556aea16780 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.unordered_write: 0 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T08:12:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.row_cache: None 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.wal_filter: None 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.preserve_deletes: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.two_write_queues: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.atomic_flush: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T08:12:53.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.log_readahead_size: 0 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_background_jobs: 2 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_background_compactions: -1 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_subcompactions: 1 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T08:12:53.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_open_files: -1 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_background_flushes: -1 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Compression algorithms supported: 2024-09-11T08:12:53.975 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kZSTD supported: 0 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kXpressCompression supported: 0 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kBZip2Compression supported: 0 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kLZ4Compression supported: 1 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kZlibCompression supported: 1 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: kSnappyCompression supported: 1 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.merge_operator: 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_filter: None 2024-09-11T08:12:53.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5556ae8ffa38) 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: index_type: 0 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: data_block_index_type: 0 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: index_shortening: 1 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T08:12:53.977 INFO:journalctl@ceph.mon.a.smithi173.stdout: hash_index_allow_collision: 1 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: checksum: 1 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: no_block_cache: 0 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_cache: 0x5556ae9351f0 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_cache_options: 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: capacity : 536870912 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: num_shard_bits : 4 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: strict_capacity_limit : 0 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_cache_compressed: (nil) 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: persistent_cache: (nil) 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_size: 4096 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_size_deviation: 10 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_restart_interval: 16 2024-09-11T08:12:53.978 INFO:journalctl@ceph.mon.a.smithi173.stdout: index_block_restart_interval: 1 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: metadata_block_size: 4096 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: partition_filters: 0 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: use_delta_encoding: 1 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: whole_key_filtering: 1 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: verify_compression: 0 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: format_version: 4 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: enable_index_compression: 1 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout: block_align: 0 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression: NoCompression 2024-09-11T08:12:53.979 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.num_levels: 7 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T08:12:53.980 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T08:12:53.981 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.arena_block_size: 4194304 2024-09-11T08:12:53.982 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T08:12:53.983 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T08:12:53.983 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-11T08:12:53.983 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.inplace_update_support: 0 2024-09-11T08:12:53.984 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.bloom_locality: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.max_successive_merges: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.ttl: 2592000 2024-09-11T08:12:53.985 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.enable_blob_files: false 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.min_blob_size: 0 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042373690349, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-11T08:12:53.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042373691069, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 81514, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 79753, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10324, "raw_average_key_size": 47, "raw_value_size": 73924, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726042373, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "68184c46-1743-4953-ab98-e05e24121b83", "db_session_id": "ZCQVGW539OLG3WBKNBGN"}} 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042373691394, "job": 1, "event": "recovery_finished"} 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5556ae968700 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: DB pointer 0x5556ae938000 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** DB Stats ** 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T08:12:53.987 INFO:journalctl@ceph.mon.a.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: L0 2/0 81.39 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Sum 2/0 81.39 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.988 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Cumulative compaction: 0.00 GB write, 26.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Interval compaction: 0.00 GB write, 26.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.989 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T08:12:53.990 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.990 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:12:53.990 INFO:journalctl@ceph.mon.a.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:12:53.990 INFO:journalctl@ceph.mon.a.smithi173.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: L0 2/0 81.39 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: Sum 2/0 81.39 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.0 0.00 0.00 1 0.000 0 0 2024-09-11T08:12:53.991 INFO:journalctl@ceph.mon.a.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: Cumulative compaction: 0.00 GB write, 25.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: starting mon.a rank 0 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???) e1 preinit fsid 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:12:53.992 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).mds e1 new map 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).mds e1 print_map 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: e1 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: legacy client fscid: -1 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout: No filesystems configured 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T08:12:53.993 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 bash[29626]: e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: monmap e1: 1 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: fsmap 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 ceph-mon[29664]: mgrmap e1: no daemons active 2024-09-11T08:12:53.994 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:53 smithi173 systemd[1]: Started Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:12:54.840 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.192+0000 7f7cf3679640 1 Processor -- start 2024-09-11T08:12:54.840 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf3679640 1 -- start start 2024-09-11T08:12:54.840 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf3679640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:54.840 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf3679640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec100ca0 con 0x7f7cec100350 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf1415640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf1415640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36608/0 (socket says 172.21.15.173:36608) 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf1415640 1 -- 172.21.15.173:0/2889058263 learned_addr learned my addr 172.21.15.173:0/2889058263 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.193+0000 7f7cf1415640 1 -- 172.21.15.173:0/2889058263 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec100de0 con 0x7f7cec100350 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.195+0000 7f7cf1415640 1 --2- 172.21.15.173:0/2889058263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009840 tx=0x7f7ce80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cf5b0c778b1dca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7ce3fff640 1 -- 172.21.15.173:0/2889058263 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce802add0 con 0x7f7cec100350 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7ce3fff640 1 -- 172.21.15.173:0/2889058263 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f7ce8032860 con 0x7f7cec100350 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7ce3fff640 1 -- 172.21.15.173:0/2889058263 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce8031630 con 0x7f7cec100350 2024-09-11T08:12:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 -- 172.21.15.173:0/2889058263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 msgr2=0x7f7cec100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 --2- 172.21.15.173:0/2889058263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009840 tx=0x7f7ce80091d0 comp rx=0 tx=0).stop 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 -- 172.21.15.173:0/2889058263 shutdown_connections 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 --2- 172.21.15.173:0/2889058263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec100760 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 -- 172.21.15.173:0/2889058263 >> 172.21.15.173:0/2889058263 conn(0x7f7cec0fbb50 msgr2=0x7f7cec0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 -- 172.21.15.173:0/2889058263 shutdown_connections 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.196+0000 7f7cf3679640 1 -- 172.21.15.173:0/2889058263 wait complete. 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf3679640 1 Processor -- start 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf3679640 1 -- start start 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf3679640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf3679640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec10f400 con 0x7f7cec100350 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf1415640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf1415640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36616/0 (socket says 172.21.15.173:36616) 2024-09-11T08:12:54.842 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf1415640 1 -- 172.21.15.173:0/3242274391 learned_addr learned my addr 172.21.15.173:0/3242274391 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.197+0000 7f7cf1415640 1 -- 172.21.15.173:0/3242274391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8009450 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7cf1415640 1 --2- 172.21.15.173:0/3242274391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8031ad0 tx=0x7f7ce802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce803b440 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec10f600 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f7ce803b9c0 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ce803a3a0 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec10fa70 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7ce8039070 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.198+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7ce8044450 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.199+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec04b720 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.201+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7cec10fa70 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.255+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f7cec102060 con 0x7f7cec100350 2024-09-11T08:12:54.843 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.260+0000 7f7ce1ffb640 1 -- 172.21.15.173:0/3242274391 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7ce8049060 con 0x7f7cec100350 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 msgr2=0x7f7cec10eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 --2- 172.21.15.173:0/3242274391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8031ad0 tx=0x7f7ce802c040 comp rx=0 tx=0).stop 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 shutdown_connections 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 --2- 172.21.15.173:0/3242274391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cec100350 0x7f7cec10eec0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 >> 172.21.15.173:0/3242274391 conn(0x7f7cec0fbb50 msgr2=0x7f7cec0fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 shutdown_connections 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:54.261+0000 7f7cf3679640 1 -- 172.21.15.173:0/3242274391 wait complete. 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:Creating mgr... 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T08:12:54.844 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T08:12:55.013 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y 2024-09-11T08:12:55.013 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y.service: Unit ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y.service not loaded. 2024-09-11T08:12:55.157 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968.target.wants/ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-4492cbfa-7015-11ef-bcea-c7b262605968@.service. 2024-09-11T08:12:55.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3242274391' entity='client.admin' 2024-09-11T08:12:55.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 podman[29902]: 2024-09-11 08:12:55.392713624 +0000 UTC m=+0.117662334 container create 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T08:12:55.659 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T08:12:55.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout disabled 2024-09-11T08:12:55.667 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T08:12:55.667 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:12:55.667 INFO:teuthology.orchestra.run.smithi173.stdout:firewalld.service is not enabled 2024-09-11T08:12:55.667 INFO:teuthology.orchestra.run.smithi173.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T08:12:55.676 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T08:12:55.676 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout disabled 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:firewalld.service is not enabled 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mgr to start... 2024-09-11T08:12:55.684 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mgr... 2024-09-11T08:12:55.934 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 podman[29902]: 2024-09-11 08:12:55.587068732 +0000 UTC m=+0.312017444 container init 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:12:55.934 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 podman[29902]: 2024-09-11 08:12:55.591656562 +0000 UTC m=+0.316605281 container start 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T08:12:55.934 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 bash[29902]: 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f 2024-09-11T08:12:55.935 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 systemd[1]: Started Ceph mgr.y for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:12:55.935 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:55.711+0000 7fc04f195ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:12:55.935 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:55.767+0000 7fc04f195ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:12:55.935 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:55.833+0000 7fc04f195ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:12:56.199 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:55 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:55.959+0000 7fc04f195ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:12:56.199 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:56 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:56.099+0000 7fc04f195ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:12:56.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1949552377' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T08:12:56.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:56 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:56.370+0000 7fc04f195ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:12:56.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:56 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:56.430+0000 7fc04f195ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:12:56.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:12:56.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:12:56.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsid": "4492cbfa-7015-11ef-bcea-c7b262605968", 2024-09-11T08:12:56.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 0 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T08:12:56.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T08:12:56.837 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T08:12:56.838 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T08:12:56.846 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T08:12:56.846 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T08:12:56.846 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T08:12:56.846 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T08:12:56.847 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T08:12:56.848 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T08:12:48.743610+0000", 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.166+0000 7f1b79116640 1 Processor -- start 2024-09-11T08:12:56.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.166+0000 7f1b79116640 1 -- start start 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.166+0000 7f1b79116640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.166+0000 7f1b79116640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741034a0 con 0x7f1b74074480 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.167+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.167+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36638/0 (socket says 172.21.15.173:36638) 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.167+0000 7f1b72d9d640 1 -- 172.21.15.173:0/3062433410 learned_addr learned my addr 172.21.15.173:0/3062433410 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.167+0000 7f1b72d9d640 1 -- 172.21.15.173:0/3062433410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b741035e0 con 0x7f1b74074480 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b72d9d640 1 --2- 172.21.15.173:0/3062433410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009840 tx=0x7f1b640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522b9fcc1363f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b71d9b640 1 -- 172.21.15.173:0/3062433410 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6402add0 con 0x7f1b74074480 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b71d9b640 1 -- 172.21.15.173:0/3062433410 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f1b64032860 con 0x7f1b74074480 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b71d9b640 1 -- 172.21.15.173:0/3062433410 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b64031630 con 0x7f1b74074480 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b79116640 1 -- 172.21.15.173:0/3062433410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 msgr2=0x7f1b74102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:56.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.168+0000 7f1b79116640 1 --2- 172.21.15.173:0/3062433410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009840 tx=0x7f1b640091d0 comp rx=0 tx=0).stop 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- 172.21.15.173:0/3062433410 shutdown_connections 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 --2- 172.21.15.173:0/3062433410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74102f60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- 172.21.15.173:0/3062433410 >> 172.21.15.173:0/3062433410 conn(0x7f1b740faa30 msgr2=0x7f1b740fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- 172.21.15.173:0/3062433410 shutdown_connections 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- 172.21.15.173:0/3062433410 wait complete. 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 Processor -- start 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- start start 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.169+0000 7f1b79116640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74100dd0 con 0x7f1b74074480 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36640/0 (socket says 172.21.15.173:36640) 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b72d9d640 1 -- 172.21.15.173:0/1949552377 learned_addr learned my addr 172.21.15.173:0/1949552377 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:12:56.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b72d9d640 1 -- 172.21.15.173:0/1949552377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009450 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b72d9d640 1 --2- 172.21.15.173:0/1949552377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1b64032fb0 tx=0x7f1b6402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b64031bf0 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f1b64031d50 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6403be60 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b740fee60 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b740ff2d0 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1b64039070 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.170+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1b64044ca0 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.171+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404b720 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.173+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1b64049060 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.233+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1b74104260 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.233+0000 7f1b5b7fe640 1 -- 172.21.15.173:0/1949552377 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7f1b6403f070 con 0x7f1b74074480 2024-09-11T08:12:56.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 msgr2=0x7f1b74100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 --2- 172.21.15.173:0/1949552377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1b64032fb0 tx=0x7f1b6402c040 comp rx=0 tx=0).stop 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 shutdown_connections 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 --2- 172.21.15.173:0/1949552377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b74074480 0x7f1b74100890 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 >> 172.21.15.173:0/1949552377 conn(0x7f1b740faa30 msgr2=0x7f1b740fb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 shutdown_connections 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:56.234+0000 7f1b79116640 1 -- 172.21.15.173:0/1949552377 wait complete. 2024-09-11T08:12:56.853 INFO:teuthology.orchestra.run.smithi173.stdout:mgr not available, waiting (1/15)... 2024-09-11T08:12:56.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:56 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:56.594+0000 7fc04f195ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:12:57.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:57.441+0000 7fc04f195ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:12:57.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:57.504+0000 7fc04f195ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:12:58.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.213+0000 7fc04f195ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:12:58.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.322+0000 7fc04f195ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:12:58.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.442+0000 7fc04f195ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:12:58.887 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.500+0000 7fc04f195ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:12:58.887 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.626+0000 7fc04f195ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:12:58.887 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.691+0000 7fc04f195ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:12:58.887 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.748+0000 7fc04f195ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:12:58.887 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.885+0000 7fc04f195ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:12:59.174 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:58 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:58.949+0000 7fc04f195ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:12:59.174 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:59.015+0000 7fc04f195ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:12:59.174 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:59.096+0000 7fc04f195ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:12:59.174 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:59.172+0000 7fc04f195ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:12:59.432 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:59.229+0000 7fc04f195ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:12:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1690027728' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsid": "4492cbfa-7015-11ef-bcea-c7b262605968", 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T08:13:00.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 0 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T08:13:00.025 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:00.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T08:13:00.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T08:13:00.026 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T08:13:00.034 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T08:13:00.035 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T08:12:48.743610+0000", 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:00.036 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.365+0000 7fb60080e640 1 Processor -- start 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb60080e640 1 -- start start 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb60080e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb60080e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0ffb30 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb5fa59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb5fa59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36652/0 (socket says 172.21.15.173:36652) 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb5fa59c640 1 -- 172.21.15.173:0/265009038 learned_addr learned my addr 172.21.15.173:0/265009038 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.366+0000 7fb5fa59c640 1 -- 172.21.15.173:0/265009038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0ffc70 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.367+0000 7fb5fa59c640 1 --2- 172.21.15.173:0/265009038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00baf0 tx=0x7fb5ec00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fac70dde59a9c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.367+0000 7fb5f959a640 1 -- 172.21.15.173:0/265009038 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec032640 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.367+0000 7fb5f959a640 1 -- 172.21.15.173:0/265009038 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fb5ec032bc0 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.037 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.367+0000 7fb5f959a640 1 -- 172.21.15.173:0/265009038 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec031a00 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 -- 172.21.15.173:0/265009038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 msgr2=0x7fb5fc0ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 --2- 172.21.15.173:0/265009038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00baf0 tx=0x7fb5ec00b460 comp rx=0 tx=0).stop 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 -- 172.21.15.173:0/265009038 shutdown_connections 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 --2- 172.21.15.173:0/265009038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc0ff5f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 -- 172.21.15.173:0/265009038 >> 172.21.15.173:0/265009038 conn(0x7fb5fc0faa00 msgr2=0x7fb5fc0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 -- 172.21.15.173:0/265009038 shutdown_connections 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 -- 172.21.15.173:0/265009038 wait complete. 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.368+0000 7fb60080e640 1 Processor -- start 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb60080e640 1 -- start start 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb60080e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb60080e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc111570 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5fa59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:00.038 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5fa59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36654/0 (socket says 172.21.15.173:36654) 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5fa59c640 1 -- 172.21.15.173:0/1690027728 learned_addr learned my addr 172.21.15.173:0/1690027728 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5fa59c640 1 -- 172.21.15.173:0/1690027728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec00b700 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5fa59c640 1 --2- 172.21.15.173:0/1690027728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00bac0 tx=0x7fb5ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec032920 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fb5ec03b840 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc111770 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec045590 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.369+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc111be0 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.370+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb5ec045980 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.370+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb5ec04fbd0 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.370+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc04b720 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.372+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb5fc111be0 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.431+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb5fc112b80 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.432+0000 7fb5eaffd640 1 -- 172.21.15.173:0/1690027728 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7fb5ec036020 con 0x7fb5fc0ff1e0 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 msgr2=0x7fb5fc111030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 --2- 172.21.15.173:0/1690027728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00bac0 tx=0x7fb5ec008040 comp rx=0 tx=0).stop 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 shutdown_connections 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 --2- 172.21.15.173:0/1690027728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5fc0ff1e0 0x7fb5fc111030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 >> 172.21.15.173:0/1690027728 conn(0x7fb5fc0faa00 msgr2=0x7fb5fc103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 shutdown_connections 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:12:59.433+0000 7fb60080e640 1 -- 172.21.15.173:0/1690027728 wait complete. 2024-09-11T08:13:00.040 INFO:teuthology.orchestra.run.smithi173.stdout:mgr not available, waiting (2/15)... 2024-09-11T08:13:00.216 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:12:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:12:59.993+0000 7fc04f195ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: Activating manager daemon y 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: mgrmap e2: y(active, starting, since 0.00310541s) 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: Manager daemon y is now available 2024-09-11T08:13:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:13:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' 2024-09-11T08:13:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:13:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' 2024-09-11T08:13:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:00 smithi173 ceph-mon[29664]: from='mgr.14100 172.21.15.173:0/2009318448' entity='mgr.y' 2024-09-11T08:13:02.269 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:02 smithi173 ceph-mon[29664]: mgrmap e3: y(active, since 1.00691s) 2024-09-11T08:13:03.266 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:03 smithi173 ceph-mon[29664]: mgrmap e4: y(active, since 2s) 2024-09-11T08:13:03.267 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/260537059' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsid": "4492cbfa-7015-11ef-bcea-c7b262605968", 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 0 2024-09-11T08:13:03.271 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T08:13:03.272 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T08:13:03.281 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T08:13:03.282 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ], 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T08:12:48.743610+0000", 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout }, 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:03.283 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.464+0000 7f8a32efc640 1 Processor -- start 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.464+0000 7f8a32efc640 1 -- start start 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a32efc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a32efc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c103490 con 0x7f8a2c073c00 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a30c98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a30c98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37088/0 (socket says 172.21.15.173:37088) 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a30c98640 1 -- 172.21.15.173:0/4025772011 learned_addr learned my addr 172.21.15.173:0/4025772011 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.465+0000 7f8a30c98640 1 -- 172.21.15.173:0/4025772011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c1035d0 con 0x7f8a2c073c00 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.466+0000 7f8a30c98640 1 --2- 172.21.15.173:0/4025772011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009840 tx=0x7f8a200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175ebe71bcd7bc94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.466+0000 7f8a2b7fe640 1 -- 172.21.15.173:0/4025772011 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a2002ae60 con 0x7f8a2c073c00 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.466+0000 7f8a2b7fe640 1 -- 172.21.15.173:0/4025772011 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f8a20032860 con 0x7f8a2c073c00 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.466+0000 7f8a2b7fe640 1 -- 172.21.15.173:0/4025772011 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a20031660 con 0x7f8a2c073c00 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- 172.21.15.173:0/4025772011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 msgr2=0x7f8a2c102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 --2- 172.21.15.173:0/4025772011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009840 tx=0x7f8a200091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:03.284 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- 172.21.15.173:0/4025772011 shutdown_connections 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 --2- 172.21.15.173:0/4025772011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c102f50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- 172.21.15.173:0/4025772011 >> 172.21.15.173:0/4025772011 conn(0x7f8a2c0faa00 msgr2=0x7f8a2c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- 172.21.15.173:0/4025772011 shutdown_connections 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- 172.21.15.173:0/4025772011 wait complete. 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 Processor -- start 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.467+0000 7f8a32efc640 1 -- start start 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a32efc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a32efc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c10f3f0 con 0x7f8a2c073c00 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a30c98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a30c98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37094/0 (socket says 172.21.15.173:37094) 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a30c98640 1 -- 172.21.15.173:0/260537059 learned_addr learned my addr 172.21.15.173:0/260537059 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a30c98640 1 -- 172.21.15.173:0/260537059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20009450 con 0x7f8a2c073c00 2024-09-11T08:13:03.285 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a30c98640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a20033fd0 tx=0x7f8a2002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a20031be0 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f8a20031d40 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a2003de90 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.468+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c10f5f0 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.469+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c10fa60 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.469+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 45481+0+0 (secure 0 0 0) 0x7f8a20039070 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.469+0000 7f8a297fa640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 0x7f8a1c03b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.469+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8a2006c9e0 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.469+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c05ed70 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.470+0000 7f8a2bfff640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 0x7f8a1c03b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.470+0000 7f8a2bfff640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 0x7f8a1c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.474+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a20041070 con 0x7f8a2c073c00 2024-09-11T08:13:03.286 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.687+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8a2c04b720 con 0x7f8a2c073c00 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.687+0000 7f8a297fa640 1 -- 172.21.15.173:0/260537059 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f8a20037030 con 0x7f8a2c073c00 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 msgr2=0x7f8a1c03b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 0x7f8a1c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 msgr2=0x7f8a2c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a20033fd0 tx=0x7f8a2002c040 comp rx=0 tx=0).stop 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 shutdown_connections 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f8a1c039420 0x7f8a1c03b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 --2- 172.21.15.173:0/260537059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2c073c00 0x7f8a2c10eeb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 >> 172.21.15.173:0/260537059 conn(0x7f8a2c0faa00 msgr2=0x7f8a2c0fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 shutdown_connections 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:02.690+0000 7f8a32efc640 1 -- 172.21.15.173:0/260537059 wait complete. 2024-09-11T08:13:03.287 INFO:teuthology.orchestra.run.smithi173.stdout:mgr is available 2024-09-11T08:13:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3416799105' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout fsid = 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T08:13:09.019 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f3829db7640 1 Processor -- start 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f3829db7640 1 -- start start 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f3829db7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f3829db7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824100ca0 con 0x7f3824100350 2024-09-11T08:13:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f38237fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f38237fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37108/0 (socket says 172.21.15.173:37108) 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f38237fe640 1 -- 172.21.15.173:0/778750150 learned_addr learned my addr 172.21.15.173:0/778750150 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.652+0000 7f38237fe640 1 -- 172.21.15.173:0/778750150 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824100de0 con 0x7f3824100350 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.653+0000 7f38237fe640 1 --2- 172.21.15.173:0/778750150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3814009840 tx=0x7f38140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3828e09426bda555 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.653+0000 7f38227fc640 1 -- 172.21.15.173:0/778750150 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f381402add0 con 0x7f3824100350 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.653+0000 7f38227fc640 1 -- 172.21.15.173:0/778750150 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f3814032860 con 0x7f3824100350 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.653+0000 7f38227fc640 1 -- 172.21.15.173:0/778750150 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3814031630 con 0x7f3824100350 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 -- 172.21.15.173:0/778750150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 msgr2=0x7f3824100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 --2- 172.21.15.173:0/778750150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3814009840 tx=0x7f38140091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 -- 172.21.15.173:0/778750150 shutdown_connections 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 --2- 172.21.15.173:0/778750150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f3824100760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 -- 172.21.15.173:0/778750150 >> 172.21.15.173:0/778750150 conn(0x7f38240fbb50 msgr2=0x7f38240fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:09.021 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 -- 172.21.15.173:0/778750150 shutdown_connections 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 -- 172.21.15.173:0/778750150 wait complete. 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.654+0000 7f3829db7640 1 Processor -- start 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f3829db7640 1 -- start start 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f3829db7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f3829db7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382410f400 con 0x7f3824100350 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f38237fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f38237fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37114/0 (socket says 172.21.15.173:37114) 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f38237fe640 1 -- 172.21.15.173:0/3416799105 learned_addr learned my addr 172.21.15.173:0/3416799105 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f38237fe640 1 -- 172.21.15.173:0/3416799105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814009450 con 0x7f3824100350 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f38237fe640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3814031ad0 tx=0x7f381402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f381403b440 con 0x7f3824100350 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f381403b9c0 con 0x7f3824100350 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382410f600 con 0x7f3824100350 2024-09-11T08:13:09.022 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f381403a3a0 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.655+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382410fa70 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.656+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 45481+0+0 (secure 0 0 0) 0x7f3814039070 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.657+0000 7f380bfff640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 0x7f380c03b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.657+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382404b720 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.657+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f381406c410 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.657+0000 7f3822ffd640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 0x7f380c03b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.657+0000 7f3822ffd640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 0x7f380c03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.661+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3814039500 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.815+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f382410fa70 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.816+0000 7f380bfff640 1 -- 172.21.15.173:0/3416799105 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+318 (secure 0 0 0) 0x7f381403f020 con 0x7f3824100350 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 msgr2=0x7f380c03b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 0x7f380c03b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3818006fd0 tx=0x7f3818006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:09.023 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 msgr2=0x7f382410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3814031ad0 tx=0x7f381402c040 comp rx=0 tx=0).stop 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 shutdown_connections 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7f380c0393d0 0x7f380c03b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 --2- 172.21.15.173:0/3416799105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3824100350 0x7f382410eec0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 >> 172.21.15.173:0/3416799105 conn(0x7f38240fbb50 msgr2=0x7f38240fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 shutdown_connections 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:03.818+0000 7f3829db7640 1 -- 172.21.15.173:0/3416799105 wait complete. 2024-09-11T08:13:09.024 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling cephadm module... 2024-09-11T08:13:12.695 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3254032154' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T08:13:12.696 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setuser ceph since I am not root 2024-09-11T08:13:12.696 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setgroup ceph since I am not root 2024-09-11T08:13:12.696 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:12.574+0000 7f2878d09ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:13:12.696 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:12.628+0000 7f2878d09ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:13:12.696 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:12.693+0000 7f2878d09ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:13:12.953 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:12.816+0000 7f2878d09ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:13:13.206 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:12 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:12.951+0000 7f2878d09ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:13:13.206 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:13.204+0000 7f2878d09ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:13:13.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3254032154' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T08:13:13.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:13 smithi173 ceph-mon[29664]: mgrmap e5: y(active, since 12s) 2024-09-11T08:13:13.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:13.263+0000 7f2878d09ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:13:13.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:13.423+0000 7f2878d09ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:13:14.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:14 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:14.262+0000 7f2878d09ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:13:14.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:14 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:14.325+0000 7f2878d09ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:13:15.331 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.036+0000 7f2878d09ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:13:15.331 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.147+0000 7f2878d09ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:13:15.331 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.269+0000 7f2878d09ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:13:15.331 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.329+0000 7f2878d09ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:13:15.585 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.457+0000 7f2878d09ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:13:15.586 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.524+0000 7f2878d09ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:13:15.586 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.583+0000 7f2878d09ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.187+0000 7fc8946bc640 1 Processor -- start 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.188+0000 7fc8946bc640 1 -- start start 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.188+0000 7fc8946bc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.188+0000 7fc8946bc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c100ca0 con 0x7fc88c100350 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.188+0000 7fc892458640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.188+0000 7fc892458640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52764/0 (socket says 172.21.15.173:52764) 2024-09-11T08:13:15.644 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.189+0000 7fc892458640 1 -- 172.21.15.173:0/847883121 learned_addr learned my addr 172.21.15.173:0/847883121 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.189+0000 7fc892458640 1 -- 172.21.15.173:0/847883121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c100de0 con 0x7fc88c100350 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.189+0000 7fc892458640 1 --2- 172.21.15.173:0/847883121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc880009840 tx=0x7fc8800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8399935820ccf1f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc891456640 1 -- 172.21.15.173:0/847883121 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc88002add0 con 0x7fc88c100350 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc891456640 1 -- 172.21.15.173:0/847883121 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fc880032860 con 0x7fc88c100350 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc891456640 1 -- 172.21.15.173:0/847883121 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc880031630 con 0x7fc88c100350 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 -- 172.21.15.173:0/847883121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 msgr2=0x7fc88c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 --2- 172.21.15.173:0/847883121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc880009840 tx=0x7fc8800091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 -- 172.21.15.173:0/847883121 shutdown_connections 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 --2- 172.21.15.173:0/847883121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c100760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 -- 172.21.15.173:0/847883121 >> 172.21.15.173:0/847883121 conn(0x7fc88c0fbb50 msgr2=0x7fc88c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 -- 172.21.15.173:0/847883121 shutdown_connections 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.190+0000 7fc8946bc640 1 -- 172.21.15.173:0/847883121 wait complete. 2024-09-11T08:13:15.645 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc8946bc640 1 Processor -- start 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc8946bc640 1 -- start start 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc8946bc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc8946bc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c10f3e0 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc892458640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc892458640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52776/0 (socket says 172.21.15.173:52776) 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc892458640 1 -- 172.21.15.173:0/3254032154 learned_addr learned my addr 172.21.15.173:0/3254032154 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.191+0000 7fc892458640 1 -- 172.21.15.173:0/3254032154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880009450 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc892458640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc880031ad0 tx=0x7fc88002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc88003b440 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c10f5e0 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fc88003b9c0 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc88003a3a0 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.192+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c10fa50 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 45481+0+0 (secure 0 0 0) 0x7fc880039070 con 0x7fc88c100350 2024-09-11T08:13:15.646 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c04b720 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc87effd640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 0x7fc87803b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc88006c410 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc891c57640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 0x7fc87803b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.193+0000 7fc891c57640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 0x7fc87803b880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc888006fd0 tx=0x7fc888006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.198+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc88003b5a0 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.392+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fc88c10fa50 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.445+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 5) v1 ==== 45492+0+0 (secure 0 0 0) 0x7fc880037c20 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.446+0000 7fc87effd640 1 -- 172.21.15.173:0/3254032154 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fc8800433b0 con 0x7fc88c100350 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.448+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 msgr2=0x7fc87803b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.448+0000 7fc8946bc640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 0x7fc87803b880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc888006fd0 tx=0x7fc888006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.448+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 msgr2=0x7fc88c10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:15.647 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.448+0000 7fc8946bc640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc880031ad0 tx=0x7fc88002c040 comp rx=0 tx=0).stop 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 shutdown_connections 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fc8780393d0 0x7fc87803b880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 --2- 172.21.15.173:0/3254032154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88c100350 0x7fc88c10eea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 >> 172.21.15.173:0/3254032154 conn(0x7fc88c0fbb50 msgr2=0x7fc88c0fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 shutdown_connections 2024-09-11T08:13:15.648 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:12.449+0000 7fc8946bc640 1 -- 172.21.15.173:0/3254032154 wait complete. 2024-09-11T08:13:15.855 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.723+0000 7f2878d09ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:13:15.856 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.788+0000 7f2878d09ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:13:15.856 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.853+0000 7f2878d09ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:13:16.126 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.941+0000 7f2878d09ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:13:16.126 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:16 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:15.998+0000 7f2878d09ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:13:16.126 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:16 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:16.057+0000 7f2878d09ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:13:16.676 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1677953412' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T08:13:16.943 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:16 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:16.824+0000 7f2878d09ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:13:16.951 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:16.951 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T08:13:16.951 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.123+0000 7fdd54ed7640 1 Processor -- start 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.123+0000 7fdd54ed7640 1 -- start start 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd54ed7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd54ed7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500ffb60 con 0x7fdd500ff210 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd4e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd4e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52794/0 (socket says 172.21.15.173:52794) 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd4e59c640 1 -- 172.21.15.173:0/3847736700 learned_addr learned my addr 172.21.15.173:0/3847736700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.124+0000 7fdd4e59c640 1 -- 172.21.15.173:0/3847736700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500ffca0 con 0x7fdd500ff210 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.125+0000 7fdd4e59c640 1 --2- 172.21.15.173:0/3847736700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000baf0 tx=0x7fdd4000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babb24fabe07ee49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:16.952 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.125+0000 7fdd4d59a640 1 -- 172.21.15.173:0/3847736700 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd40032640 con 0x7fdd500ff210 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.125+0000 7fdd4d59a640 1 -- 172.21.15.173:0/3847736700 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fdd40032bc0 con 0x7fdd500ff210 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.125+0000 7fdd4d59a640 1 -- 172.21.15.173:0/3847736700 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd40031a00 con 0x7fdd500ff210 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 -- 172.21.15.173:0/3847736700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 msgr2=0x7fdd500ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/3847736700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000baf0 tx=0x7fdd4000b460 comp rx=0 tx=0).stop 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 -- 172.21.15.173:0/3847736700 shutdown_connections 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/3847736700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd500ff620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 -- 172.21.15.173:0/3847736700 >> 172.21.15.173:0/3847736700 conn(0x7fdd500faa10 msgr2=0x7fdd500fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 -- 172.21.15.173:0/3847736700 shutdown_connections 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.126+0000 7fdd54ed7640 1 -- 172.21.15.173:0/3847736700 wait complete. 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd54ed7640 1 Processor -- start 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd54ed7640 1 -- start start 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd54ed7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:16.953 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd54ed7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501115f0 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd4e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd4e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52804/0 (socket says 172.21.15.173:52804) 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd4e59c640 1 -- 172.21.15.173:0/1677953412 learned_addr learned my addr 172.21.15.173:0/1677953412 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd4e59c640 1 -- 172.21.15.173:0/1677953412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4000b700 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd4e59c640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000bac0 tx=0x7fdd40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd40032920 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd501117f0 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.127+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fdd4003b840 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.128+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd50111c60 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.128+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd40045590 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.128+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5004b720 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.128+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 45492+0+0 (secure 0 0 0) 0x7fdd4003b420 con 0x7fdd500ff210 2024-09-11T08:13:16.954 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.129+0000 7fdd3effd640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 0x7fdd3803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.129+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdd4006d760 con 0x7fdd500ff210 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.129+0000 7fdd4dd9b640 1 -- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 msgr2=0x7fdd3803b910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/2991830914 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.129+0000 7fdd4dd9b640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 0x7fdd3803b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.133+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdd4003b9b0 con 0x7fdd500ff210 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.330+0000 7fdd4dd9b640 1 -- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 msgr2=0x7fdd3803b910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/2991830914 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.330+0000 7fdd4dd9b640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 0x7fdd3803b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.336+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdd50111c60 con 0x7fdd500ff210 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.336+0000 7fdd3effd640 1 -- 172.21.15.173:0/1677953412 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fdd40036020 con 0x7fdd500ff210 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 msgr2=0x7fdd3803b910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 0x7fdd3803b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 msgr2=0x7fdd501110b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000bac0 tx=0x7fdd40008040 comp rx=0 tx=0).stop 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 shutdown_connections 2024-09-11T08:13:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:6800/2991830914,v1:172.21.15.173:6801/2991830914] conn(0x7fdd38039460 0x7fdd3803b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 --2- 172.21.15.173:0/1677953412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd500ff210 0x7fdd501110b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 >> 172.21.15.173:0/1677953412 conn(0x7fdd500faa10 msgr2=0x7fdd50103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 shutdown_connections 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:16.338+0000 7fdd54ed7640 1 -- 172.21.15.173:0/1677953412 wait complete. 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for the mgr to restart... 2024-09-11T08:13:16.956 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mgr epoch 5... 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: Active manager daemon y restarted 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: Activating manager daemon y 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: mgrmap e6: y(active, starting, since 0.00302467s) 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:13:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: Manager daemon y is now available 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:13:17.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:17 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:13:18.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-mon[29664]: Found migration_current of "None". Setting to last migration. 2024-09-11T08:13:18.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-mon[29664]: mgrmap e7: y(active, since 1.00557s) 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.327+0000 7f1510c41640 1 Processor -- start 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f1510c41640 1 -- start start 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f1510c41640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f1510c41640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c103440 con 0x7f150c0744d0 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f150a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f150a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52884/0 (socket says 172.21.15.173:52884) 2024-09-11T08:13:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f150a59c640 1 -- 172.21.15.173:0/3642432526 learned_addr learned my addr 172.21.15.173:0/3642432526 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.328+0000 7f150a59c640 1 -- 172.21.15.173:0/3642432526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c103580 con 0x7f150c0744d0 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.329+0000 7f150a59c640 1 --2- 172.21.15.173:0/3642432526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009840 tx=0x7f14fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7200fb96f508bbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.329+0000 7f150959a640 1 -- 172.21.15.173:0/3642432526 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14fc02add0 con 0x7f150c0744d0 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.329+0000 7f150959a640 1 -- 172.21.15.173:0/3642432526 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f14fc032860 con 0x7f150c0744d0 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.329+0000 7f150959a640 1 -- 172.21.15.173:0/3642432526 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14fc031630 con 0x7f150c0744d0 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- 172.21.15.173:0/3642432526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 msgr2=0x7f150c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 --2- 172.21.15.173:0/3642432526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009840 tx=0x7f14fc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- 172.21.15.173:0/3642432526 shutdown_connections 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 --2- 172.21.15.173:0/3642432526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c102f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- 172.21.15.173:0/3642432526 >> 172.21.15.173:0/3642432526 conn(0x7f150c0fa970 msgr2=0x7f150c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- 172.21.15.173:0/3642432526 shutdown_connections 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- 172.21.15.173:0/3642432526 wait complete. 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 Processor -- start 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 -- start start 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.330+0000 7f1510c41640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f1510c41640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c10f440 con 0x7f150c0744d0 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f150a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f150a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52894/0 (socket says 172.21.15.173:52894) 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f150a59c640 1 -- 172.21.15.173:0/4017272115 learned_addr learned my addr 172.21.15.173:0/4017272115 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f150a59c640 1 -- 172.21.15.173:0/4017272115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009450 con 0x7f150c0744d0 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f150a59c640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006a70 tx=0x7f14fc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14fc03b440 con 0x7f150c0744d0 2024-09-11T08:13:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f14fc03b9c0 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c10f640 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14fc03a3a0 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.331+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c1100f0 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.332+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 6) v1 ==== 45259+0+0 (secure 0 0 0) 0x7f14fc039070 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.332+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f14fc06c520 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.829+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mgrmap(e 7) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f14fc039d30 con 0x7f150c0744d0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.829+0000 7f14faffd640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 0x7f14f403c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.829+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14f403c850 con 0x7f14f4039f30 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.830+0000 7f1509d9b640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 0x7f14f403c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.830+0000 7f1509d9b640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 0x7f14f403c310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1500006fd0 tx=0x7f1500006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.831+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f14f403c850 con 0x7f14f4039f30 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.839+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f150c10fab0 con 0x7f14f4039f30 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f14faffd640 1 -- 172.21.15.173:0/4017272115 <== mgr.14118 v2:172.21.15.173:6800/542277039 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f150c10fab0 con 0x7f14f4039f30 2024-09-11T08:13:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 msgr2=0x7f14f403c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 0x7f14f403c310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1500006fd0 tx=0x7f1500006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 msgr2=0x7f150c10ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006a70 tx=0x7f14fc02c040 comp rx=0 tx=0).stop 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 shutdown_connections 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f14f4039f30 0x7f14f403c310 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 --2- 172.21.15.173:0/4017272115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f150c0744d0 0x7f150c10ef00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 >> 172.21.15.173:0/4017272115 conn(0x7f150c0fa970 msgr2=0x7f150c0fb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 shutdown_connections 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:17.840+0000 7f1510c41640 1 -- 172.21.15.173:0/4017272115 wait complete. 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:mgr epoch 5 is available 2024-09-11T08:13:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:Setting orchestrator backend to cephadm... 2024-09-11T08:13:18.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:18.432+0000 7f282b0f7640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:08:13:18] ENGINE Error in HTTPServer.serve 2024-09-11T08:13:18.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Traceback (most recent call last): 2024-09-11T08:13:18.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:13:18.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._connections.run(self.expiration_interval) 2024-09-11T08:13:18.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._run(expiration_interval) 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s = self.context.wrap_socket( 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: return self.sslsocket_class._create( 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self.do_handshake() 2024-09-11T08:13:18.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:13:18.719 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._sslobj.do_handshake() 2024-09-11T08:13:18.719 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:13:18.719 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:18 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:19.581 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T08:13:19.581 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T08:13:19.581 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:18] ENGINE Bus STARTING 2024-09-11T08:13:19.581 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:18] ENGINE Serving on https://172.21.15.173:7150 2024-09-11T08:13:19.581 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:18] ENGINE Bus STARTED 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:18] ENGINE Error in HTTPServer.serve 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: Traceback (most recent call last): 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._run(expiration_interval) 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: s = self.context.wrap_socket( 2024-09-11T08:13:19.582 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: return self.sslsocket_class._create( 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: self.do_handshake() 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._sslobj.do_handshake() 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:19.583 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:19 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:19.585 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25ac7c2640 1 Processor -- start 2024-09-11T08:13:19.585 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25ac7c2640 1 -- start start 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25ac7c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25ac7c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4100ca0 con 0x7f25a4100350 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25aa55e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25aa55e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52908/0 (socket says 172.21.15.173:52908) 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25aa55e640 1 -- 172.21.15.173:0/1706916012 learned_addr learned my addr 172.21.15.173:0/1706916012 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.812+0000 7f25aa55e640 1 -- 172.21.15.173:0/1706916012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4100de0 con 0x7f25a4100350 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.813+0000 7f25aa55e640 1 --2- 172.21.15.173:0/1706916012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009840 tx=0x7f25a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db15105f1b7b0b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.813+0000 7f25a955c640 1 -- 172.21.15.173:0/1706916012 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a002add0 con 0x7f25a4100350 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.813+0000 7f25a955c640 1 -- 172.21.15.173:0/1706916012 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f25a0032860 con 0x7f25a4100350 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.813+0000 7f25a955c640 1 -- 172.21.15.173:0/1706916012 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a0031630 con 0x7f25a4100350 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- 172.21.15.173:0/1706916012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 msgr2=0x7f25a4100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/1706916012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009840 tx=0x7f25a00091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- 172.21.15.173:0/1706916012 shutdown_connections 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/1706916012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4100760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- 172.21.15.173:0/1706916012 >> 172.21.15.173:0/1706916012 conn(0x7f25a40fbb50 msgr2=0x7f25a40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- 172.21.15.173:0/1706916012 shutdown_connections 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- 172.21.15.173:0/1706916012 wait complete. 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 Processor -- start 2024-09-11T08:13:19.587 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.814+0000 7f25ac7c2640 1 -- start start 2024-09-11T08:13:19.590 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25ac7c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:19.590 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25ac7c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40769d0 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25aa55e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25aa55e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52914/0 (socket says 172.21.15.173:52914) 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25aa55e640 1 -- 172.21.15.173:0/2171607762 learned_addr learned my addr 172.21.15.173:0/2171607762 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25aa55e640 1 -- 172.21.15.173:0/2171607762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0009450 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25aa55e640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25a0031ad0 tx=0x7f25a002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a003b440 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a4074a60 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f25a003b9c0 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a003a3a0 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.815+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a4074ed0 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.816+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 7) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f25a0039070 con 0x7f25a4100350 2024-09-11T08:13:19.591 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.816+0000 7f259affd640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 0x7f259003b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.816+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a404b720 con 0x7f25a4100350 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.816+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f25a006c810 con 0x7f25a4100350 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.816+0000 7f25a9d5d640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 0x7f259003b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.817+0000 7f25a9d5d640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 0x7f259003b7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2594006fd0 tx=0x7f2594006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.821+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f25a003bd80 con 0x7f25a4100350 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.987+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a4075350 con 0x7f25900392f0 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.994+0000 7f259affd640 1 -- 172.21.15.173:0/2171607762 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f25a4075350 con 0x7f25900392f0 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 msgr2=0x7f259003b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 0x7f259003b7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2594006fd0 tx=0x7f2594006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 msgr2=0x7f25a4076490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:19.592 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25a0031ad0 tx=0x7f25a002c040 comp rx=0 tx=0).stop 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 shutdown_connections 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f25900392f0 0x7f259003b7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 --2- 172.21.15.173:0/2171607762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25a4100350 0x7f25a4076490 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 >> 172.21.15.173:0/2171607762 conn(0x7f25a40fbb50 msgr2=0x7f25a40fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 shutdown_connections 2024-09-11T08:13:19.593 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:18.997+0000 7f25ac7c2640 1 -- 172.21.15.173:0/2171607762 wait complete. 2024-09-11T08:13:20.460 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:20 smithi173 ceph-mon[29664]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:20.460 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:20 smithi173 ceph-mon[29664]: mgrmap e8: y(active, since 2s) 2024-09-11T08:13:20.786 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T08:13:20.786 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.024+0000 7f2e949c0640 1 Processor -- start 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.024+0000 7f2e949c0640 1 -- start start 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e949c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e949c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90103400 con 0x7f2e90074510 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e8e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e8e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52924/0 (socket says 172.21.15.173:52924) 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e8e59c640 1 -- 172.21.15.173:0/1625516353 learned_addr learned my addr 172.21.15.173:0/1625516353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.025+0000 7f2e8e59c640 1 -- 172.21.15.173:0/1625516353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90103540 con 0x7f2e90074510 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.026+0000 7f2e8e59c640 1 --2- 172.21.15.173:0/1625516353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009840 tx=0x7f2e800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d3c735cc28f533 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.026+0000 7f2e8d59a640 1 -- 172.21.15.173:0/1625516353 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e8002add0 con 0x7f2e90074510 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.026+0000 7f2e8d59a640 1 -- 172.21.15.173:0/1625516353 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f2e80032860 con 0x7f2e90074510 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.026+0000 7f2e8d59a640 1 -- 172.21.15.173:0/1625516353 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e80031630 con 0x7f2e90074510 2024-09-11T08:13:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- 172.21.15.173:0/1625516353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 msgr2=0x7f2e90102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 --2- 172.21.15.173:0/1625516353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009840 tx=0x7f2e800091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- 172.21.15.173:0/1625516353 shutdown_connections 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 --2- 172.21.15.173:0/1625516353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e90102ec0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- 172.21.15.173:0/1625516353 >> 172.21.15.173:0/1625516353 conn(0x7f2e900fa9d0 msgr2=0x7f2e900fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- 172.21.15.173:0/1625516353 shutdown_connections 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- 172.21.15.173:0/1625516353 wait complete. 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 Processor -- start 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.027+0000 7f2e949c0640 1 -- start start 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e949c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e949c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9010f460 con 0x7f2e90074510 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e8e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e8e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52940/0 (socket says 172.21.15.173:52940) 2024-09-11T08:13:20.788 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e8e59c640 1 -- 172.21.15.173:0/805401729 learned_addr learned my addr 172.21.15.173:0/805401729 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e8e59c640 1 -- 172.21.15.173:0/805401729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80009450 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e8e59c640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e80032fb0 tx=0x7f2e8002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e80031bf0 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f2e80031d50 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e8003be60 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9010f660 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.028+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9010fad0 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.029+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f2e80039070 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.029+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9004b720 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.029+0000 7f2e86ffd640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 0x7f2e7c03b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.029+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2e8006c4b0 con 0x7f2e90074510 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.029+0000 7f2e8dd9b640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 0x7f2e7c03b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:20.789 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.030+0000 7f2e8dd9b640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 0x7f2e7c03b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006fd0 tx=0x7f2e78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.034+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e80043a00 con 0x7f2e90074510 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.188+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e9010fad0 con 0x7f2e7c0394b0 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.189+0000 7f2e86ffd640 1 -- 172.21.15.173:0/805401729 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f2e9010fad0 con 0x7f2e7c0394b0 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 msgr2=0x7f2e7c03b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 0x7f2e7c03b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006fd0 tx=0x7f2e78006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 msgr2=0x7f2e9010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e80032fb0 tx=0x7f2e8002c040 comp rx=0 tx=0).stop 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 shutdown_connections 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f2e7c0394b0 0x7f2e7c03b960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 --2- 172.21.15.173:0/805401729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e90074510 0x7f2e9010ef20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 >> 172.21.15.173:0/805401729 conn(0x7f2e900fa9d0 msgr2=0x7f2e900fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 shutdown_connections 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:20.191+0000 7f2e949c0640 1 -- 172.21.15.173:0/805401729 wait complete. 2024-09-11T08:13:20.790 INFO:teuthology.orchestra.run.smithi173.stdout:Generating ssh key... 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-mon[29664]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Generating public/private rsa key pair. 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Your identification has been saved in /tmp/tmp_br7tiz8/key 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Your public key has been saved in /tmp/tmp_br7tiz8/key.pub 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: The key fingerprint is: 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: SHA256:HdFaURwBNDDfVIOn7msOo9ZuH7u+ouTo/MR78DRof+Q ceph-4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:13:21.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: The key's randomart image is: 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: +---[RSA 3072]----+ 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | ++==*=.| 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | +o=...| 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | .o. + | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | ... . | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | S o . | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | .+ o o | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | .+*o=. | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | . =.oBoEo | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: | .+o*=.BO+ | 2024-09-11T08:13:21.718 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:21 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: +----[SHA256]-----+ 2024-09-11T08:13:22.543 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.213+0000 7f51a1242640 1 Processor -- start 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.213+0000 7f51a1242640 1 -- start start 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f51a1242640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f51a1242640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0ffb60 con 0x7f519c0ff210 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f519ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f519ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52948/0 (socket says 172.21.15.173:52948) 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f519ad9d640 1 -- 172.21.15.173:0/1961547932 learned_addr learned my addr 172.21.15.173:0/1961547932 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.214+0000 7f519ad9d640 1 -- 172.21.15.173:0/1961547932 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0ffca0 con 0x7f519c0ff210 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f519ad9d640 1 --2- 172.21.15.173:0/1961547932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f518c009840 tx=0x7f518c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bf9625933751c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f5199d9b640 1 -- 172.21.15.173:0/1961547932 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c02add0 con 0x7f519c0ff210 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f5199d9b640 1 -- 172.21.15.173:0/1961547932 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f518c032860 con 0x7f519c0ff210 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f5199d9b640 1 -- 172.21.15.173:0/1961547932 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c031630 con 0x7f519c0ff210 2024-09-11T08:13:22.544 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f51a1242640 1 -- 172.21.15.173:0/1961547932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 msgr2=0x7f519c0ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.215+0000 7f51a1242640 1 --2- 172.21.15.173:0/1961547932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f518c009840 tx=0x7f518c0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- 172.21.15.173:0/1961547932 shutdown_connections 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 --2- 172.21.15.173:0/1961547932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0ff620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- 172.21.15.173:0/1961547932 >> 172.21.15.173:0/1961547932 conn(0x7f519c0faa10 msgr2=0x7f519c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- 172.21.15.173:0/1961547932 shutdown_connections 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- 172.21.15.173:0/1961547932 wait complete. 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 Processor -- start 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- start start 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.216+0000 7f51a1242640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c111bc0 con 0x7f519c0ff210 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f519ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f519ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52962/0 (socket says 172.21.15.173:52962) 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f519ad9d640 1 -- 172.21.15.173:0/1296667610 learned_addr learned my addr 172.21.15.173:0/1296667610 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f519ad9d640 1 -- 172.21.15.173:0/1296667610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c009450 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f519ad9d640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f518c006a70 tx=0x7f518c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c031e20 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f518c03b860 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c111d00 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f518c03a3a0 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.217+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c112170 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.218+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f518c039070 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.218+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c04b720 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.218+0000 7f51937fe640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 0x7f518803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.218+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f518c06c850 con 0x7f519c0ff210 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.218+0000 7f519a59c640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 0x7f518803b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:22.546 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.219+0000 7f519a59c640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 0x7f518803b910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5184006fd0 tx=0x7f5184006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.223+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f518c03bc40 con 0x7f519c0ff210 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.378+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f519c0fbb30 con 0x7f5188039460 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.552+0000 7f51937fe640 1 -- 172.21.15.173:0/1296667610 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f519c0fbb30 con 0x7f5188039460 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 msgr2=0x7f518803b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 0x7f518803b910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5184006fd0 tx=0x7f5184006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 msgr2=0x7f519c0743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f518c006a70 tx=0x7f518c02c040 comp rx=0 tx=0).stop 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 shutdown_connections 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f5188039460 0x7f518803b910 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 --2- 172.21.15.173:0/1296667610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f519c0ff210 0x7f519c0743d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.554+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 >> 172.21.15.173:0/1296667610 conn(0x7f519c0faa10 msgr2=0x7f519c0fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.555+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 shutdown_connections 2024-09-11T08:13:22.547 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:21.555+0000 7f51a1242640 1 -- 172.21.15.173:0/1296667610 wait complete. 2024-09-11T08:13:22.653 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:22 smithi173 ceph-mon[29664]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:22.653 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:22 smithi173 ceph-mon[29664]: Generating ssh key... 2024-09-11T08:13:22.653 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:22 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:22.653 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:22 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:23.699 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChIHIcmMFKckrTSZERhI0mPqklYrI6uvdLU0iHJETAkhQScu/7Yafn9tXPd7TI/2KweAPpjHHLAssVnCVAihRXHSrXlS97+556ZAUzgWVv5QQVfmiI2G43QqND37FpFeAnOVqzNzSbjZdDza5yjzvDHiIPLQt61kbWgbYiCh5kI2sAbHfMGNfiwhnDBvj0oV3dO5DczzJPDwMrJ3OhD8OQMK17+JniJRhz0iPzMMIjWykqxFHPV7qo3FbP0RPvmTXgvN6PLCD3iSkL3qg7PQX0IF3JnrKMnRGR38K/+JjppuEDEM2FSvKftkaddCj8uQKzQ3OdMtXC/uCOTi+LlDWYta7PmGHxuu/8yJY7EaiQIeqOTlmDoAUCEEh1On/V5y7Whm+h99BYZXWnyoBEz3lgggZRLTJ52NcXdyUof+odpXAPDtkQazxQI4OX8pwgPLGx5sZuyJqJhnG+iQzGRix/9peURJPieu7h7Zp8acokeKHo4ckhKAe8sNtpWI93nLM= ceph-4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f6ae1640 1 Processor -- start 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f6ae1640 1 -- start start 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f6ae1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f6ae1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0100ca0 con 0x7f55f0100350 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f487d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f487d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44716/0 (socket says 172.21.15.173:44716) 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f487d640 1 -- 172.21.15.173:0/3996450821 learned_addr learned my addr 172.21.15.173:0/3996450821 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.000+0000 7f55f487d640 1 -- 172.21.15.173:0/3996450821 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0100de0 con 0x7f55f0100350 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.001+0000 7f55f487d640 1 --2- 172.21.15.173:0/3996450821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009840 tx=0x7f55e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231fa126d69beff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:23.700 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.001+0000 7f55ef7fe640 1 -- 172.21.15.173:0/3996450821 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e402add0 con 0x7f55f0100350 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.001+0000 7f55ef7fe640 1 -- 172.21.15.173:0/3996450821 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f55e4032860 con 0x7f55f0100350 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.001+0000 7f55ef7fe640 1 -- 172.21.15.173:0/3996450821 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e4031630 con 0x7f55f0100350 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 -- 172.21.15.173:0/3996450821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 msgr2=0x7f55f0100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/3996450821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009840 tx=0x7f55e40091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 -- 172.21.15.173:0/3996450821 shutdown_connections 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/3996450821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f0100760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 -- 172.21.15.173:0/3996450821 >> 172.21.15.173:0/3996450821 conn(0x7f55f00fbb50 msgr2=0x7f55f00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 -- 172.21.15.173:0/3996450821 shutdown_connections 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 -- 172.21.15.173:0/3996450821 wait complete. 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.002+0000 7f55f6ae1640 1 Processor -- start 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f6ae1640 1 -- start start 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f6ae1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:23.701 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f6ae1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f010f400 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f487d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f487d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44728/0 (socket says 172.21.15.173:44728) 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f487d640 1 -- 172.21.15.173:0/1789905719 learned_addr learned my addr 172.21.15.173:0/1789905719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f487d640 1 -- 172.21.15.173:0/1789905719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4009450 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.003+0000 7f55f487d640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55e4031ad0 tx=0x7f55e402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.004+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e403b440 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.004+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f55e403b9c0 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.004+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e403a3a0 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.004+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f010f600 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.004+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f010fa70 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f55e4039070 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f004b720 con 0x7f55f0100350 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55ed7fa640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 0x7f55e003b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:23.702 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f55e406c900 con 0x7f55f0100350 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55effff640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 0x7f55e003b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.005+0000 7f55effff640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 0x7f55e003b910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006fd0 tx=0x7f55dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.009+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f55e4039a80 con 0x7f55f0100350 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.165+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f010fa70 con 0x7f55e0039460 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.165+0000 7f55ed7fa640 1 -- 172.21.15.173:0/1789905719 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f55f010fa70 con 0x7f55e0039460 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 msgr2=0x7f55e003b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 0x7f55e003b910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006fd0 tx=0x7f55dc006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 msgr2=0x7f55f010eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55e4031ad0 tx=0x7f55e402c040 comp rx=0 tx=0).stop 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 shutdown_connections 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f55e0039460 0x7f55e003b910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 --2- 172.21.15.173:0/1789905719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f0100350 0x7f55f010eec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:23.703 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 >> 172.21.15.173:0/1789905719 conn(0x7f55f00fbb50 msgr2=0x7f55f00fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:23.704 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 shutdown_connections 2024-09-11T08:13:23.704 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:23.167+0000 7f55f6ae1640 1 -- 172.21.15.173:0/1789905719 wait complete. 2024-09-11T08:13:23.704 INFO:teuthology.orchestra.run.smithi173.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T08:13:23.704 INFO:teuthology.orchestra.run.smithi173.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T08:13:23.704 INFO:teuthology.orchestra.run.smithi173.stdout:Adding host smithi173... 2024-09-11T08:13:23.817 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:23 smithi173 ceph-mon[29664]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:24 smithi173 ceph-mon[29664]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "addr": "172.21.15.173", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:25.608 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:25 smithi173 ceph-mon[29664]: Deploying cephadm binary to smithi173 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout Added host 'smithi173' with addr '172.21.15.173' 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa57a90d640 1 Processor -- start 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa57a90d640 1 -- start start 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa57a90d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa57a90d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574100ca0 con 0x7fa574100350 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa573fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa573fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44740/0 (socket says 172.21.15.173:44740) 2024-09-11T08:13:27.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa573fff640 1 -- 172.21.15.173:0/3214321264 learned_addr learned my addr 172.21.15.173:0/3214321264 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.140+0000 7fa573fff640 1 -- 172.21.15.173:0/3214321264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574100de0 con 0x7fa574100350 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.141+0000 7fa573fff640 1 --2- 172.21.15.173:0/3214321264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa5640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763bde8e50330237 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.141+0000 7fa572ffd640 1 -- 172.21.15.173:0/3214321264 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa56402add0 con 0x7fa574100350 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.141+0000 7fa572ffd640 1 -- 172.21.15.173:0/3214321264 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fa564032860 con 0x7fa574100350 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.141+0000 7fa572ffd640 1 -- 172.21.15.173:0/3214321264 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa564031630 con 0x7fa574100350 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- 172.21.15.173:0/3214321264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 msgr2=0x7fa574100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 --2- 172.21.15.173:0/3214321264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa5640091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- 172.21.15.173:0/3214321264 shutdown_connections 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 --2- 172.21.15.173:0/3214321264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa574100760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- 172.21.15.173:0/3214321264 >> 172.21.15.173:0/3214321264 conn(0x7fa5740fbb50 msgr2=0x7fa5740fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- 172.21.15.173:0/3214321264 shutdown_connections 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- 172.21.15.173:0/3214321264 wait complete. 2024-09-11T08:13:27.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 Processor -- start 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 -- start start 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.142+0000 7fa57a90d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa57a90d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57410f400 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa573fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa573fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44752/0 (socket says 172.21.15.173:44752) 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa573fff640 1 -- 172.21.15.173:0/2171981968 learned_addr learned my addr 172.21.15.173:0/2171981968 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa573fff640 1 -- 172.21.15.173:0/2171981968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009450 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa573fff640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa564031ad0 tx=0x7fa56402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa56403b440 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57410f600 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7fa56403b9c0 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa56403a3a0 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.143+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57410fa70 con 0x7fa574100350 2024-09-11T08:13:27.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.144+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7fa564039070 con 0x7fa574100350 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.144+0000 7fa570ff9640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 0x7fa55c03b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.144+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57404b720 con 0x7fa574100350 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.144+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa56406c7a0 con 0x7fa574100350 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.144+0000 7fa5737fe640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 0x7fa55c03b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.145+0000 7fa5737fe640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 0x7fa55c03b8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa568006fd0 tx=0x7fa568006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:27.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.149+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa56403f080 con 0x7fa574100350 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:24.308+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "addr": "172.21.15.173", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5740fcc50 con 0x7fa55c039420 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.020+0000 7fa570ff9640 1 -- 172.21.15.173:0/2171981968 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa5740fcc50 con 0x7fa55c039420 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 msgr2=0x7fa55c03b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 0x7fa55c03b8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa568006fd0 tx=0x7fa568006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 msgr2=0x7fa57410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa564031ad0 tx=0x7fa56402c040 comp rx=0 tx=0).stop 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 shutdown_connections 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fa55c039420 0x7fa55c03b8d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 --2- 172.21.15.173:0/2171981968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa574100350 0x7fa57410eec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 >> 172.21.15.173:0/2171981968 conn(0x7fa5740fbb50 msgr2=0x7fa5740fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 shutdown_connections 2024-09-11T08:13:27.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.023+0000 7fa57a90d640 1 -- 172.21.15.173:0/2171981968 wait complete. 2024-09-11T08:13:27.579 INFO:teuthology.orchestra.run.smithi173.stdout:Deploying unmanaged mon service... 2024-09-11T08:13:28.398 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:28 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:28.399 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:28 smithi173 ceph-mon[29664]: Added host smithi173 2024-09-11T08:13:28.399 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:28 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:29.454 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:29 smithi173 ceph-mon[29664]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:29.454 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:29 smithi173 ceph-mon[29664]: Saving service mon spec with placement count:5 2024-09-11T08:13:29.454 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:29 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.990+0000 7f3596706640 1 Processor -- start 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.990+0000 7f3596706640 1 -- start start 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f3596706640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f3596706640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35900ffb30 con 0x7f35900ff1e0 2024-09-11T08:13:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f358ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f358ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44760/0 (socket says 172.21.15.173:44760) 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f358ffff640 1 -- 172.21.15.173:0/1107984562 learned_addr learned my addr 172.21.15.173:0/1107984562 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.991+0000 7f358ffff640 1 -- 172.21.15.173:0/1107984562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900ffc70 con 0x7f35900ff1e0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f358ffff640 1 --2- 172.21.15.173:0/1107984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f358000baf0 tx=0x7f358000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf382741053c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f358f7fe640 1 -- 172.21.15.173:0/1107984562 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3580032640 con 0x7f35900ff1e0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f358f7fe640 1 -- 172.21.15.173:0/1107984562 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f3580032bc0 con 0x7f35900ff1e0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f358f7fe640 1 -- 172.21.15.173:0/1107984562 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3580031a00 con 0x7f35900ff1e0 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f3596706640 1 -- 172.21.15.173:0/1107984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 msgr2=0x7f35900ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f3596706640 1 --2- 172.21.15.173:0/1107984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f358000baf0 tx=0x7f358000b460 comp rx=0 tx=0).stop 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f3596706640 1 -- 172.21.15.173:0/1107984562 shutdown_connections 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f3596706640 1 --2- 172.21.15.173:0/1107984562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f35900ff5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:29.833 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.992+0000 7f3596706640 1 -- 172.21.15.173:0/1107984562 >> 172.21.15.173:0/1107984562 conn(0x7f35900faa00 msgr2=0x7f35900fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 -- 172.21.15.173:0/1107984562 shutdown_connections 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 -- 172.21.15.173:0/1107984562 wait complete. 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 Processor -- start 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 -- start start 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f3596706640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359010d160 con 0x7f35900ff1e0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f358ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f358ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44776/0 (socket says 172.21.15.173:44776) 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.993+0000 7f358ffff640 1 -- 172.21.15.173:0/288328853 learned_addr learned my addr 172.21.15.173:0/288328853 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f358ffff640 1 -- 172.21.15.173:0/288328853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358000b700 con 0x7f35900ff1e0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f358ffff640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3580003080 tx=0x7f358003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3580032850 con 0x7f35900ff1e0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 937+0+0 (secure 0 0 0) 0x7f35800329b0 con 0x7f35900ff1e0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359010d360 con 0x7f35900ff1e0 2024-09-11T08:13:29.834 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35800453f0 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.994+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359010d7d0 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f35800456b0 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359004b720 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f358d7fa640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 0x7f357c03b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f358006fbf0 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f3587fff640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 0x7f357c03b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:27.995+0000 7f3587fff640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 0x7f357c03b910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.000+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f358004c950 con 0x7f35900ff1e0 2024-09-11T08:13:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.164+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f359010d7d0 con 0x7f357c039460 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.171+0000 7f358d7fa640 1 -- 172.21.15.173:0/288328853 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f359010d7d0 con 0x7f357c039460 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 msgr2=0x7f357c03b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 0x7f357c03b910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 msgr2=0x7f359010cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3580003080 tx=0x7f358003d040 comp rx=0 tx=0).stop 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 shutdown_connections 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f357c039460 0x7f357c03b910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 --2- 172.21.15.173:0/288328853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35900ff1e0 0x7f359010cc20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 >> 172.21.15.173:0/288328853 conn(0x7f35900faa00 msgr2=0x7f3590103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 shutdown_connections 2024-09-11T08:13:29.836 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:28.173+0000 7f3596706640 1 -- 172.21.15.173:0/288328853 wait complete. 2024-09-11T08:13:29.837 INFO:teuthology.orchestra.run.smithi173.stdout:Deploying unmanaged mgr service... 2024-09-11T08:13:30.737 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:30 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:30.737 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:30 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:31 smithi173 ceph-mon[29664]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:31 smithi173 ceph-mon[29664]: Saving service mgr spec with placement count:2 2024-09-11T08:13:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:31 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:31 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f1912301640 1 Processor -- start 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f1912301640 1 -- start start 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f1912301640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f1912301640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c076950 con 0x7f190c076540 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f190bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f190bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44780/0 (socket says 172.21.15.173:44780) 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f190bfff640 1 -- 172.21.15.173:0/1245278013 learned_addr learned my addr 172.21.15.173:0/1245278013 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:31.737 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.285+0000 7f190bfff640 1 -- 172.21.15.173:0/1245278013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c075000 con 0x7f190c076540 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.286+0000 7f190bfff640 1 --2- 172.21.15.173:0/1245278013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009840 tx=0x7f18fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9162367d4c0b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.286+0000 7f190affd640 1 -- 172.21.15.173:0/1245278013 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18fc02add0 con 0x7f190c076540 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.286+0000 7f190affd640 1 -- 172.21.15.173:0/1245278013 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f18fc032880 con 0x7f190c076540 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.286+0000 7f190affd640 1 -- 172.21.15.173:0/1245278013 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18fc031630 con 0x7f190c076540 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- 172.21.15.173:0/1245278013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 msgr2=0x7f190c074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 --2- 172.21.15.173:0/1245278013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009840 tx=0x7f18fc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- 172.21.15.173:0/1245278013 shutdown_connections 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 --2- 172.21.15.173:0/1245278013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c074ac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- 172.21.15.173:0/1245278013 >> 172.21.15.173:0/1245278013 conn(0x7f190c0fbb50 msgr2=0x7f190c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- 172.21.15.173:0/1245278013 shutdown_connections 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- 172.21.15.173:0/1245278013 wait complete. 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 Processor -- start 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.287+0000 7f1912301640 1 -- start start 2024-09-11T08:13:31.738 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1912301640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1912301640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c111650 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f190bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f190bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44786/0 (socket says 172.21.15.173:44786) 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f190bfff640 1 -- 172.21.15.173:0/3434947191 learned_addr learned my addr 172.21.15.173:0/3434947191 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f190bfff640 1 -- 172.21.15.173:0/3434947191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc009450 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f190bfff640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006a70 tx=0x7f18fc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18fc031e20 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f18fc03b880 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18fc03a3a0 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190c111850 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.288+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190c111cc0 con 0x7f190c076540 2024-09-11T08:13:31.739 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.289+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f18fc039070 con 0x7f190c076540 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.289+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c04b720 con 0x7f190c076540 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.289+0000 7f1908ff9640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 0x7f18f403b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.289+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f18fc06c630 con 0x7f190c076540 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.290+0000 7f190b7fe640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 0x7f18f403b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.290+0000 7f190b7fe640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 0x7f18f403b960 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1900006fd0 tx=0x7f1900006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.294+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f18fc039920 con 0x7f190c076540 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.484+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f190c111cc0 con 0x7f18f40394b0 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.492+0000 7f1908ff9640 1 -- 172.21.15.173:0/3434947191 <== mgr.14118 v2:172.21.15.173:6800/542277039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f190c111cc0 con 0x7f18f40394b0 2024-09-11T08:13:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 msgr2=0x7f18f403b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 0x7f18f403b960 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1900006fd0 tx=0x7f1900006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 msgr2=0x7f190c111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006a70 tx=0x7f18fc02c040 comp rx=0 tx=0).stop 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 shutdown_connections 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f18f40394b0 0x7f18f403b960 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 --2- 172.21.15.173:0/3434947191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f190c076540 0x7f190c111110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 >> 172.21.15.173:0/3434947191 conn(0x7f190c0fbb50 msgr2=0x7f190c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 shutdown_connections 2024-09-11T08:13:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:30.494+0000 7f1912301640 1 -- 172.21.15.173:0/3434947191 wait complete. 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.197+0000 7fe3f491f640 1 Processor -- start 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.197+0000 7fe3f491f640 1 -- start start 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3f491f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3f491f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00ffb30 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3ee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3ee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59620/0 (socket says 172.21.15.173:59620) 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3ee59c640 1 -- 172.21.15.173:0/756358695 learned_addr learned my addr 172.21.15.173:0/756358695 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.198+0000 7fe3ee59c640 1 -- 172.21.15.173:0/756358695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00ffc70 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3ee59c640 1 --2- 172.21.15.173:0/756358695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009840 tx=0x7fe3e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ee27913f57bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3ed59a640 1 -- 172.21.15.173:0/756358695 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e802add0 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3ed59a640 1 -- 172.21.15.173:0/756358695 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fe3e8032880 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3ed59a640 1 -- 172.21.15.173:0/756358695 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8031630 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3f491f640 1 -- 172.21.15.173:0/756358695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 msgr2=0x7fe3f00ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.199+0000 7fe3f491f640 1 --2- 172.21.15.173:0/756358695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009840 tx=0x7fe3e80091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- 172.21.15.173:0/756358695 shutdown_connections 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 --2- 172.21.15.173:0/756358695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f00ff5f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- 172.21.15.173:0/756358695 >> 172.21.15.173:0/756358695 conn(0x7fe3f00faa00 msgr2=0x7fe3f00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- 172.21.15.173:0/756358695 shutdown_connections 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- 172.21.15.173:0/756358695 wait complete. 2024-09-11T08:13:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 Processor -- start 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- start start 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3f491f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f010f410 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3ee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3ee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59626/0 (socket says 172.21.15.173:59626) 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.200+0000 7fe3ee59c640 1 -- 172.21.15.173:0/1401154180 learned_addr learned my addr 172.21.15.173:0/1401154180 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3ee59c640 1 -- 172.21.15.173:0/1401154180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009450 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3ee59c640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006a70 tx=0x7fe3e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8031da0 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fe3e8031f00 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f010f610 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e803b5c0 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.940 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.201+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f010fa80 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.202+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7fe3e8039070 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.202+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f004b720 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.202+0000 7fe3e6ffd640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 0x7fe3dc03b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.202+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe3e806d1d0 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.202+0000 7fe3edd9b640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 0x7fe3dc03b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.203+0000 7fe3edd9b640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 0x7fe3dc03b910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8006fd0 tx=0x7fe3d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.207+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe3e804e580 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.371+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe3f0100f80 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.376+0000 7fe3e6ffd640 1 -- 172.21.15.173:0/1401154180 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe3e8041070 con 0x7fe3f00ff1e0 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 msgr2=0x7fe3dc03b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 0x7fe3dc03b910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8006fd0 tx=0x7fe3d8006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 msgr2=0x7fe3f010eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:32.941 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006a70 tx=0x7fe3e8008040 comp rx=0 tx=0).stop 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 shutdown_connections 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fe3dc039460 0x7fe3dc03b910 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 --2- 172.21.15.173:0/1401154180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f00ff1e0 0x7fe3f010eed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 >> 172.21.15.173:0/1401154180 conn(0x7fe3f00faa00 msgr2=0x7fe3f0105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 shutdown_connections 2024-09-11T08:13:32.942 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:32.379+0000 7fe3f491f640 1 -- 172.21.15.173:0/1401154180 wait complete. 2024-09-11T08:13:33.368 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:33 smithi173 ceph-mon[29664]: from='mgr.14118 172.21.15.173:0/2692249415' entity='mgr.y' 2024-09-11T08:13:33.368 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1401154180' entity='client.admin' 2024-09-11T08:13:34.849 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a10ccb640 1 Processor -- start 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a10ccb640 1 -- start start 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a10ccb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a10ccb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0ffb60 con 0x7f0a0c0ff210 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a0a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a0a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59630/0 (socket says 172.21.15.173:59630) 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a0a59c640 1 -- 172.21.15.173:0/717083487 learned_addr learned my addr 172.21.15.173:0/717083487 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.554+0000 7f0a0a59c640 1 -- 172.21.15.173:0/717083487 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0ffca0 con 0x7f0a0c0ff210 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.555+0000 7f0a0a59c640 1 --2- 172.21.15.173:0/717083487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009840 tx=0x7f09fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25cc225e62d09aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.555+0000 7f0a0959a640 1 -- 172.21.15.173:0/717083487 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09fc02add0 con 0x7f0a0c0ff210 2024-09-11T08:13:34.850 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.555+0000 7f0a0959a640 1 -- 172.21.15.173:0/717083487 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f09fc032880 con 0x7f0a0c0ff210 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.555+0000 7f0a0959a640 1 -- 172.21.15.173:0/717083487 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09fc031630 con 0x7f0a0c0ff210 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 -- 172.21.15.173:0/717083487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 msgr2=0x7f0a0c0ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/717083487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009840 tx=0x7f09fc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 -- 172.21.15.173:0/717083487 shutdown_connections 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/717083487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c0ff620 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 -- 172.21.15.173:0/717083487 >> 172.21.15.173:0/717083487 conn(0x7f0a0c0faa10 msgr2=0x7f0a0c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 -- 172.21.15.173:0/717083487 shutdown_connections 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 -- 172.21.15.173:0/717083487 wait complete. 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.556+0000 7f0a10ccb640 1 Processor -- start 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a10ccb640 1 -- start start 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a10ccb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a10ccb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c10f510 con 0x7f0a0c0ff210 2024-09-11T08:13:34.851 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a0a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a0a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59640/0 (socket says 172.21.15.173:59640) 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a0a59c640 1 -- 172.21.15.173:0/4082995826 learned_addr learned my addr 172.21.15.173:0/4082995826 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a0a59c640 1 -- 172.21.15.173:0/4082995826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009450 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a0a59c640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f09fc006a70 tx=0x7f09fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09fc032ca0 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f09fc031e20 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09fc03b5c0 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c10f710 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.557+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c10fb80 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.558+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f09fc039070 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.558+0000 7f0a02ffd640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 0x7f09f803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.558+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c04b720 con 0x7f0a0c0ff210 2024-09-11T08:13:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.558+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f09fc06d000 con 0x7f0a0c0ff210 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.559+0000 7f0a09d9b640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 0x7f09f803b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.559+0000 7f0a09d9b640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 0x7f09f803b910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006fd0 tx=0x7f09f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.563+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f09fc03cb90 con 0x7f0a0c0ff210 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.721+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f0a0c10fb80 con 0x7f0a0c0ff210 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.727+0000 7f0a02ffd640 1 -- 172.21.15.173:0/4082995826 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f09fc041070 con 0x7f0a0c0ff210 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 msgr2=0x7f09f803b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 0x7f09f803b910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006fd0 tx=0x7f09f4006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 msgr2=0x7f0a0c10efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f09fc006a70 tx=0x7f09fc008040 comp rx=0 tx=0).stop 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 shutdown_connections 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f09f8039460 0x7f09f803b910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 --2- 172.21.15.173:0/4082995826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a0c0ff210 0x7f0a0c10efd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:34.853 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 >> 172.21.15.173:0/4082995826 conn(0x7f0a0c0faa10 msgr2=0x7f0a0c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:34.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 shutdown_connections 2024-09-11T08:13:34.854 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:33.729+0000 7f0a10ccb640 1 -- 172.21.15.173:0/4082995826 wait complete. 2024-09-11T08:13:34.854 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling the dashboard module... 2024-09-11T08:13:34.976 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4082995826' entity='client.admin' 2024-09-11T08:13:35.770 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3074975611' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T08:13:36.074 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setuser ceph since I am not root 2024-09-11T08:13:36.074 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setgroup ceph since I am not root 2024-09-11T08:13:36.074 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:35.870+0000 7f9ee7eb7ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:13:36.074 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:35.925+0000 7f9ee7eb7ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:13:36.074 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:35 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:35.990+0000 7f9ee7eb7ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:13:36.332 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:36.119+0000 7f9ee7eb7ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:13:36.332 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:36.258+0000 7f9ee7eb7ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:13:36.340 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f341b95f640 1 Processor -- start 2024-09-11T08:13:36.340 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f341b95f640 1 -- start start 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f341b95f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f341b95f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414103410 con 0x7f3414073c80 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f34196fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f34196fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59642/0 (socket says 172.21.15.173:59642) 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f34196fb640 1 -- 172.21.15.173:0/1007490134 learned_addr learned my addr 172.21.15.173:0/1007490134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.314+0000 7f34196fb640 1 -- 172.21.15.173:0/1007490134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414103550 con 0x7f3414073c80 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.315+0000 7f34196fb640 1 --2- 172.21.15.173:0/1007490134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3410009840 tx=0x7f34100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2639579a649b981 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.315+0000 7f340bfff640 1 -- 172.21.15.173:0/1007490134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f341002add0 con 0x7f3414073c80 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.315+0000 7f340bfff640 1 -- 172.21.15.173:0/1007490134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f3410032880 con 0x7f3414073c80 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.315+0000 7f340bfff640 1 -- 172.21.15.173:0/1007490134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3410031630 con 0x7f3414073c80 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- 172.21.15.173:0/1007490134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 msgr2=0x7f3414102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 --2- 172.21.15.173:0/1007490134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3410009840 tx=0x7f34100091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:36.341 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- 172.21.15.173:0/1007490134 shutdown_connections 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 --2- 172.21.15.173:0/1007490134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f3414102ed0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- 172.21.15.173:0/1007490134 >> 172.21.15.173:0/1007490134 conn(0x7f34140faa00 msgr2=0x7f34140fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- 172.21.15.173:0/1007490134 shutdown_connections 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- 172.21.15.173:0/1007490134 wait complete. 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 Processor -- start 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- start start 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.316+0000 7f341b95f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341410f430 con 0x7f3414073c80 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f34196fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f34196fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59646/0 (socket says 172.21.15.173:59646) 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f34196fb640 1 -- 172.21.15.173:0/3074975611 learned_addr learned my addr 172.21.15.173:0/3074975611 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f34196fb640 1 -- 172.21.15.173:0/3074975611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410009450 con 0x7f3414073c80 2024-09-11T08:13:36.342 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f34196fb640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3410006a70 tx=0x7f341002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3410031e20 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f341003b880 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341410f630 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f341003a3a0 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.317+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341410faa0 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.318+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 8) v1 ==== 45492+0+0 (secure 0 0 0) 0x7f3410039070 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.318+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341404b720 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.318+0000 7f3409ffb640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 0x7f340003b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.318+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f341006c650 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.318+0000 7f3418efa640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 0x7f340003b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.319+0000 7f3418efa640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 0x7f340003b960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3404006fd0 tx=0x7f3404006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.323+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3410039920 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.518+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f341410faa0 con 0x7f3414073c80 2024-09-11T08:13:36.343 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.732+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 9) v1 ==== 45505+0+0 (secure 0 0 0) 0x7f341002b040 con 0x7f3414073c80 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.733+0000 7f3409ffb640 1 -- 172.21.15.173:0/3074975611 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f341003bc20 con 0x7f3414073c80 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 msgr2=0x7f340003b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 0x7f340003b960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3404006fd0 tx=0x7f3404006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 msgr2=0x7f341410eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3410006a70 tx=0x7f341002c040 comp rx=0 tx=0).stop 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 shutdown_connections 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f34000394b0 0x7f340003b960 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 --2- 172.21.15.173:0/3074975611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414073c80 0x7f341410eef0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 >> 172.21.15.173:0/3074975611 conn(0x7f34140faa00 msgr2=0x7f34140fb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 shutdown_connections 2024-09-11T08:13:36.344 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:35.735+0000 7f341b95f640 1 -- 172.21.15.173:0/3074975611 wait complete. 2024-09-11T08:13:36.589 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:36.518+0000 7f9ee7eb7ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:13:36.589 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:36.588+0000 7f9ee7eb7ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:13:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3074975611' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T08:13:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-mon[29664]: mgrmap e9: y(active, since 18s) 2024-09-11T08:13:36.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:36.753+0000 7f9ee7eb7ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:13:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86e1967640 1 Processor -- start 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86e1967640 1 -- start start 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86e1967640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86e1967640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0ffb30 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86daffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86daffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59670/0 (socket says 172.21.15.173:59670) 2024-09-11T08:13:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86daffd640 1 -- 172.21.15.173:0/782507568 learned_addr learned my addr 172.21.15.173:0/782507568 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.779+0000 7f86daffd640 1 -- 172.21.15.173:0/782507568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0ffc70 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.780+0000 7f86daffd640 1 --2- 172.21.15.173:0/782507568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009840 tx=0x7f86cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9399798433c4ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.780+0000 7f86d9ffb640 1 -- 172.21.15.173:0/782507568 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86cc02add0 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.780+0000 7f86d9ffb640 1 -- 172.21.15.173:0/782507568 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f86cc032880 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.780+0000 7f86d9ffb640 1 -- 172.21.15.173:0/782507568 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86cc031630 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 -- 172.21.15.173:0/782507568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 msgr2=0x7f86dc0ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 --2- 172.21.15.173:0/782507568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009840 tx=0x7f86cc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 -- 172.21.15.173:0/782507568 shutdown_connections 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 --2- 172.21.15.173:0/782507568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc0ff5f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 -- 172.21.15.173:0/782507568 >> 172.21.15.173:0/782507568 conn(0x7f86dc0faa00 msgr2=0x7f86dc0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 -- 172.21.15.173:0/782507568 shutdown_connections 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.781+0000 7f86e1967640 1 -- 172.21.15.173:0/782507568 wait complete. 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86e1967640 1 Processor -- start 2024-09-11T08:13:37.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86e1967640 1 -- start start 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86e1967640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86e1967640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc111bd0 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86daffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86daffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59686/0 (socket says 172.21.15.173:59686) 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86daffd640 1 -- 172.21.15.173:0/463475693 learned_addr learned my addr 172.21.15.173:0/463475693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86daffd640 1 -- 172.21.15.173:0/463475693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009450 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86daffd640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0319c0 tx=0x7f86cc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86cc031e50 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f86cc03b880 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.782+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc111d10 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.783+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86cc03a3a0 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.783+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc112120 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.783+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 9) v1 ==== 45505+0+0 (secure 0 0 0) 0x7f86cc039070 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.783+0000 7f86c37fe640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 0x7f86c403b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.784+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f86cc06c8c0 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.784+0000 7f86da7fc640 1 -- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 msgr2=0x7f86c403b960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.784+0000 7f86da7fc640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 0x7f86c403b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.784+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc04b720 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.788+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86cc03f080 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.985+0000 7f86da7fc640 1 -- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 msgr2=0x7f86c403b960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:36.985+0000 7f86da7fc640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 0x7f86c403b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.114+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f86dc112360 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.114+0000 7f86c37fe640 1 -- 172.21.15.173:0/463475693 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f86cc037070 con 0x7f86dc0ff1e0 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 msgr2=0x7f86c403b960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:13:37.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 0x7f86c403b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 msgr2=0x7f86dc073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0319c0 tx=0x7f86cc02c040 comp rx=0 tx=0).stop 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 shutdown_connections 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7f86c40394b0 0x7f86c403b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 --2- 172.21.15.173:0/463475693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86dc0ff1e0 0x7f86dc073ae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 >> 172.21.15.173:0/463475693 conn(0x7f86dc0faa00 msgr2=0x7f86dc0fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 shutdown_connections 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:37.116+0000 7f86e1967640 1 -- 172.21.15.173:0/463475693 wait complete. 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for the mgr to restart... 2024-09-11T08:13:37.726 INFO:teuthology.orchestra.run.smithi173.stdout:Waiting for mgr epoch 9... 2024-09-11T08:13:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/463475693' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T08:13:37.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:37.711+0000 7f9ee7eb7ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:13:37.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:37.781+0000 7f9ee7eb7ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:13:38.614 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.502+0000 7f9ee7eb7ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:13:38.914 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.613+0000 7f9ee7eb7ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:13:38.914 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.732+0000 7f9ee7eb7ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:13:38.915 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.791+0000 7f9ee7eb7ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:13:38.915 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.913+0000 7f9ee7eb7ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:13:39.168 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:38 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:38.979+0000 7f9ee7eb7ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:13:39.169 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.036+0000 7f9ee7eb7ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:13:39.433 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.167+0000 7f9ee7eb7ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:13:39.433 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.231+0000 7f9ee7eb7ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:13:39.433 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.295+0000 7f9ee7eb7ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:13:39.433 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.375+0000 7f9ee7eb7ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:13:39.433 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.432+0000 7f9ee7eb7ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:13:39.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:39 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:39.489+0000 7f9ee7eb7ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: Active manager daemon y restarted 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: Activating manager daemon y 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: mgrmap e10: y(active, starting, since 0.00310208s) 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: Manager daemon y is now available 2024-09-11T08:13:40.445 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:40.446 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:13:40.446 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:13:40.446 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:40 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:40.230+0000 7f9ee7eb7ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:13:41.874 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:41.560+0000 7f9e98a14640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:08:13:41] ENGINE Error in HTTPServer.serve 2024-09-11T08:13:41.874 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Traceback (most recent call last): 2024-09-11T08:13:41.874 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:13:41.874 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._connections.run(self.expiration_interval) 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._run(expiration_interval) 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s = self.context.wrap_socket( 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: return self.sslsocket_class._create( 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self.do_handshake() 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._sslobj.do_handshake() 2024-09-11T08:13:41.875 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:13:41.876 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:13:41 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout { 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout } 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.135+0000 7fdde0924640 1 Processor -- start 2024-09-11T08:13:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fdde0924640 1 -- start start 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fdde0924640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fdde0924640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0ffb20 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fddda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fddda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59688/0 (socket says 172.21.15.173:59688) 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fddda59c640 1 -- 172.21.15.173:0/1093361094 learned_addr learned my addr 172.21.15.173:0/1093361094 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.136+0000 7fddda59c640 1 -- 172.21.15.173:0/1093361094 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0ffc60 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.137+0000 7fddda59c640 1 --2- 172.21.15.173:0/1093361094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009840 tx=0x7fddcc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0b764244d754d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.137+0000 7fddd959a640 1 -- 172.21.15.173:0/1093361094 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddcc02add0 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.137+0000 7fddd959a640 1 -- 172.21.15.173:0/1093361094 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fddcc032880 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.137+0000 7fddd959a640 1 -- 172.21.15.173:0/1093361094 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddcc031630 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- 172.21.15.173:0/1093361094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 msgr2=0x7fdddc0ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 --2- 172.21.15.173:0/1093361094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009840 tx=0x7fddcc0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- 172.21.15.173:0/1093361094 shutdown_connections 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 --2- 172.21.15.173:0/1093361094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc0ff5e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- 172.21.15.173:0/1093361094 >> 172.21.15.173:0/1093361094 conn(0x7fdddc0fa9d0 msgr2=0x7fdddc0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- 172.21.15.173:0/1093361094 shutdown_connections 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- 172.21.15.173:0/1093361094 wait complete. 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 Processor -- start 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.138+0000 7fdde0924640 1 -- start start 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fdde0924640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fdde0924640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc10f460 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddda59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59694/0 (socket says 172.21.15.173:59694) 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddda59c640 1 -- 172.21.15.173:0/2568762749 learned_addr learned my addr 172.21.15.173:0/2568762749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddda59c640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009450 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.143 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddda59c640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fddcc006a70 tx=0x7fddcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddcc031da0 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fddcc031f00 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddcc03b5c0 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc10f660 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.139+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc10fad0 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 9) v1 ==== 45505+0+0 (secure 0 0 0) 0x7fddcc039070 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddcaffd640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddc403c0e0 con 0x7fddc4039520 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fddcc06d040 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddd9d9b640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 msgr2=0x7fddc403b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.140+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.341+0000 7fddd9d9b640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 msgr2=0x7fddc403b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:42.144 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.341+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.742+0000 7fddd9d9b640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 msgr2=0x7fddc403b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:38.742+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:39.543+0000 7fddd9d9b640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 msgr2=0x7fddc403b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/542277039 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:39.543+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:40.233+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mgrmap(e 10) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fddcc06c1e0 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:40.233+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 msgr2=0x7fddc403b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:40.233+0000 7fddcaffd640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.234+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 11) v1 ==== 45399+0+0 (secure 0 0 0) 0x7fddcc06ca40 con 0x7fdddc0ff1d0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.235+0000 7fddcaffd640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 0x7fddc403f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.235+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddc403c0e0 con 0x7fddc403cfc0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.235+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 0x7fddc403f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.236+0000 7fddd9d9b640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 0x7fddc403f3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fddd0003940 tx=0x7fddd0009350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.237+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fddc403c0e0 con 0x7fddc403cfc0 2024-09-11T08:13:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdddc10fad0 con 0x7fddc403cfc0 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fddcaffd640 1 -- 172.21.15.173:0/2568762749 <== mgr.14150 v2:172.21.15.173:6800/3561883055 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fdddc10fad0 con 0x7fddc403cfc0 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 msgr2=0x7fddc403f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 0x7fddc403f3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fddd0003940 tx=0x7fddd0009350 comp rx=0 tx=0).stop 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 msgr2=0x7fdddc10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fddcc006a70 tx=0x7fddcc008040 comp rx=0 tx=0).stop 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 shutdown_connections 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fddc403cfc0 0x7fddc403f3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:6800/542277039,v1:172.21.15.173:6801/542277039] conn(0x7fddc4039520 0x7fddc403b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 --2- 172.21.15.173:0/2568762749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdddc0ff1d0 0x7fdddc10ef20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 >> 172.21.15.173:0/2568762749 conn(0x7fdddc0fa9d0 msgr2=0x7fdddc0fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.242+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 shutdown_connections 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:41.243+0000 7fdde0924640 1 -- 172.21.15.173:0/2568762749 wait complete. 2024-09-11T08:13:42.146 INFO:teuthology.orchestra.run.smithi173.stdout:mgr epoch 9 is available 2024-09-11T08:13:42.147 INFO:teuthology.orchestra.run.smithi173.stdout:Generating a dashboard self-signed certificate... 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: mgrmap e11: y(active, since 1.00579s) 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:41] ENGINE Bus STARTING 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:41] ENGINE Serving on https://172.21.15.173:7150 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:41] ENGINE Bus STARTED 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: [11/Sep/2024:08:13:41] ENGINE Error in HTTPServer.serve 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: Traceback (most recent call last): 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._run(expiration_interval) 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:13:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: s = self.context.wrap_socket( 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: return self.sslsocket_class._create( 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: self.do_handshake() 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._sslobj.do_handshake() 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:42.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:42 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:43.466 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.545+0000 7f20b3b6a640 1 Processor -- start 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.545+0000 7f20b3b6a640 1 -- start start 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b3b6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b3b6a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0ffb30 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b1906640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b1906640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55022/0 (socket says 172.21.15.173:55022) 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b1906640 1 -- 172.21.15.173:0/3298252194 learned_addr learned my addr 172.21.15.173:0/3298252194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:43.472 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.546+0000 7f20b1906640 1 -- 172.21.15.173:0/3298252194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0ffc70 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.547+0000 7f20b1906640 1 --2- 172.21.15.173:0/3298252194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f209c009840 tx=0x7f209c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fef14e9330a72b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.547+0000 7f20b0904640 1 -- 172.21.15.173:0/3298252194 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209c02add0 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.547+0000 7f20b0904640 1 -- 172.21.15.173:0/3298252194 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f209c032880 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.547+0000 7f20b0904640 1 -- 172.21.15.173:0/3298252194 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209c031630 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- 172.21.15.173:0/3298252194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 msgr2=0x7f20ac0ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/3298252194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f209c009840 tx=0x7f209c0091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- 172.21.15.173:0/3298252194 shutdown_connections 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/3298252194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac0ff5f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- 172.21.15.173:0/3298252194 >> 172.21.15.173:0/3298252194 conn(0x7f20ac0faa00 msgr2=0x7f20ac0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- 172.21.15.173:0/3298252194 shutdown_connections 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- 172.21.15.173:0/3298252194 wait complete. 2024-09-11T08:13:43.473 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 Processor -- start 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- start start 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.548+0000 7f20b3b6a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac10e370 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b1906640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b1906640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55034/0 (socket says 172.21.15.173:55034) 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b1906640 1 -- 172.21.15.173:0/347313002 learned_addr learned my addr 172.21.15.173:0/347313002 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b1906640 1 -- 172.21.15.173:0/347313002 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009450 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b1906640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f209c006a70 tx=0x7f209c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209c031da0 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f209c031f00 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac10e570 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209c03b5c0 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.549+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac10efc0 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.550+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 11) v1 ==== 45399+0+0 (secure 0 0 0) 0x7f209c039070 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.550+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac05ed70 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.550+0000 7f20a27fc640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 0x7f209803b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.550+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f209c06d0d0 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.550+0000 7f20b1105640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 0x7f209803b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.551+0000 7f20b1105640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 0x7f209803b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006fd0 tx=0x7f20a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.555+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f209c03c590 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.600+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 12) v1 ==== 45505+0+0 (secure 0 0 0) 0x7f209c03b720 con 0x7f20ac0ff1e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.735+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f20ac0fbb00 con 0x7f20980393e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.887+0000 7f20a27fc640 1 -- 172.21.15.173:0/347313002 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f20ac0fbb00 con 0x7f20980393e0 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.889+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 msgr2=0x7f209803b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.889+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 0x7f209803b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006fd0 tx=0x7f20a8006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.889+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 msgr2=0x7f20ac10de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.889+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f209c006a70 tx=0x7f209c008040 comp rx=0 tx=0).stop 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 shutdown_connections 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f20980393e0 0x7f209803b890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 --2- 172.21.15.173:0/347313002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20ac0ff1e0 0x7f20ac10de30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 >> 172.21.15.173:0/347313002 conn(0x7f20ac0faa00 msgr2=0x7f20ac0fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 shutdown_connections 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:42.890+0000 7f20b3b6a640 1 -- 172.21.15.173:0/347313002 wait complete. 2024-09-11T08:13:43.476 INFO:teuthology.orchestra.run.smithi173.stdout:Creating initial admin user... 2024-09-11T08:13:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:43 smithi173 ceph-mon[29664]: mgrmap e12: y(active, since 2s) 2024-09-11T08:13:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:43 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:43 smithi173 ceph-mon[29664]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:43 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:43 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:45.568 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:45 smithi173 ceph-mon[29664]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:45.568 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:45 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:45.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$WqSu2yJNhjbRR.8CrJq.zuHdQqiRZmLgZg8LD5Hd3GWuPynhF58rm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726042424, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T08:13:45.574 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a268db640 1 Processor -- start 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a268db640 1 -- start start 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a268db640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a268db640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20076930 con 0x7f3a20076520 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55046/0 (socket says 172.21.15.173:55046) 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a1ffff640 1 -- 172.21.15.173:0/1825938969 learned_addr learned my addr 172.21.15.173:0/1825938969 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.894+0000 7f3a1ffff640 1 -- 172.21.15.173:0/1825938969 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20074fe0 con 0x7f3a20076520 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.895+0000 7f3a1ffff640 1 --2- 172.21.15.173:0/1825938969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009840 tx=0x7f3a100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5f519a2452c7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.895+0000 7f3a1effd640 1 -- 172.21.15.173:0/1825938969 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a1002add0 con 0x7f3a20076520 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.895+0000 7f3a1effd640 1 -- 172.21.15.173:0/1825938969 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f3a10032880 con 0x7f3a20076520 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.895+0000 7f3a1effd640 1 -- 172.21.15.173:0/1825938969 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a10031630 con 0x7f3a20076520 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 -- 172.21.15.173:0/1825938969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 msgr2=0x7f3a20074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:45.575 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 --2- 172.21.15.173:0/1825938969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009840 tx=0x7f3a100091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 -- 172.21.15.173:0/1825938969 shutdown_connections 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 --2- 172.21.15.173:0/1825938969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a20074aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 -- 172.21.15.173:0/1825938969 >> 172.21.15.173:0/1825938969 conn(0x7f3a200fbb50 msgr2=0x7f3a200fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 -- 172.21.15.173:0/1825938969 shutdown_connections 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 -- 172.21.15.173:0/1825938969 wait complete. 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.896+0000 7f3a268db640 1 Processor -- start 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a268db640 1 -- start start 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a268db640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a268db640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a201115f0 con 0x7f3a20076520 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55062/0 (socket says 172.21.15.173:55062) 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a1ffff640 1 -- 172.21.15.173:0/2628748627 learned_addr learned my addr 172.21.15.173:0/2628748627 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:45.576 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a1ffff640 1 -- 172.21.15.173:0/2628748627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009450 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.897+0000 7f3a1ffff640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3a100319c0 tx=0x7f3a10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a10031e50 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f3a1003d890 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a201117f0 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a1003b5a0 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a20111c60 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.898+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 12) v1 ==== 45505+0+0 (secure 0 0 0) 0x7f3a10039070 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.899+0000 7f3a1cff9640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 0x7f3a0803b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.899+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2004b720 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.899+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3a1006d350 con 0x7f3a20076520 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.899+0000 7f3a1f7fe640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 0x7f3a0803b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:45.577 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.899+0000 7f3a1f7fe640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 0x7f3a0803b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006fd0 tx=0x7f3a14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:43.903+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3a10041070 con 0x7f3a20076520 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.075+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3a2005eb60 con 0x7f3a080394b0 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.303+0000 7f3a1cff9640 1 -- 172.21.15.173:0/2628748627 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f3a2005eb60 con 0x7f3a080394b0 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 msgr2=0x7f3a0803b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 0x7f3a0803b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006fd0 tx=0x7f3a14006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 msgr2=0x7f3a201110b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3a100319c0 tx=0x7f3a10008040 comp rx=0 tx=0).stop 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 shutdown_connections 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3a080394b0 0x7f3a0803b960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 --2- 172.21.15.173:0/2628748627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a20076520 0x7f3a201110b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 >> 172.21.15.173:0/2628748627 conn(0x7f3a200fbb50 msgr2=0x7f3a200fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 shutdown_connections 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:44.305+0000 7f3a268db640 1 -- 172.21.15.173:0/2628748627 wait complete. 2024-09-11T08:13:45.578 INFO:teuthology.orchestra.run.smithi173.stdout:Fetching dashboard port number... 2024-09-11T08:13:46.465 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/625773006' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12ea484640 1 Processor -- start 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12ea484640 1 -- start start 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12ea484640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12ea484640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e40ffb60 con 0x7f12e40ff210 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55066/0 (socket says 172.21.15.173:55066) 2024-09-11T08:13:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12e3fff640 1 -- 172.21.15.173:0/366718971 learned_addr learned my addr 172.21.15.173:0/366718971 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.988+0000 7f12e3fff640 1 -- 172.21.15.173:0/366718971 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40ffca0 con 0x7f12e40ff210 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.989+0000 7f12e3fff640 1 --2- 172.21.15.173:0/366718971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009840 tx=0x7f12d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b1b8623ebcd1b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.989+0000 7f12e2ffd640 1 -- 172.21.15.173:0/366718971 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d402add0 con 0x7f12e40ff210 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.989+0000 7f12e2ffd640 1 -- 172.21.15.173:0/366718971 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f12d4032880 con 0x7f12e40ff210 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.989+0000 7f12e2ffd640 1 -- 172.21.15.173:0/366718971 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d4031630 con 0x7f12e40ff210 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 -- 172.21.15.173:0/366718971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 msgr2=0x7f12e40ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 --2- 172.21.15.173:0/366718971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009840 tx=0x7f12d40091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 -- 172.21.15.173:0/366718971 shutdown_connections 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 --2- 172.21.15.173:0/366718971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e40ff620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 -- 172.21.15.173:0/366718971 >> 172.21.15.173:0/366718971 conn(0x7f12e40faa10 msgr2=0x7f12e40fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 -- 172.21.15.173:0/366718971 shutdown_connections 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 -- 172.21.15.173:0/366718971 wait complete. 2024-09-11T08:13:46.724 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.990+0000 7f12ea484640 1 Processor -- start 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12ea484640 1 -- start start 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12ea484640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12ea484640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e410f400 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55072/0 (socket says 172.21.15.173:55072) 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e3fff640 1 -- 172.21.15.173:0/625773006 learned_addr learned my addr 172.21.15.173:0/625773006 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e3fff640 1 -- 172.21.15.173:0/625773006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009450 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e3fff640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006a70 tx=0x7f12d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d4031da0 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f12d4031f00 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e410f600 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.991+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d403b5c0 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.992+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e410fa70 con 0x7f12e40ff210 2024-09-11T08:13:46.725 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.992+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 12) v1 ==== 45505+0+0 (secure 0 0 0) 0x7f12d4039070 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.992+0000 7f12e0ff9640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 0x7f12cc03b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.993+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f12d406d100 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.993+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e405ed70 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.993+0000 7f12e37fe640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 0x7f12cc03b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.993+0000 7f12e37fe640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 0x7f12cc03b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006fd0 tx=0x7f12d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:45.997+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f12d4041020 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.153+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f12e40008d0 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.153+0000 7f12e0ff9640 1 -- 172.21.15.173:0/625773006 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f12d4037070 con 0x7f12e40ff210 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 msgr2=0x7f12cc03b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 0x7f12cc03b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006fd0 tx=0x7f12d8006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 msgr2=0x7f12e410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006a70 tx=0x7f12d4008040 comp rx=0 tx=0).stop 2024-09-11T08:13:46.726 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 shutdown_connections 2024-09-11T08:13:46.727 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f12cc039520 0x7f12cc03b9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:46.727 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 --2- 172.21.15.173:0/625773006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12e40ff210 0x7f12e410eec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:46.727 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 >> 172.21.15.173:0/625773006 conn(0x7f12e40faa10 msgr2=0x7f12e40fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:46.727 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 shutdown_connections 2024-09-11T08:13:46.727 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:46.155+0000 7f12ea484640 1 -- 172.21.15.173:0/625773006 wait complete. 2024-09-11T08:13:46.730 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T08:13:46.730 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout disabled 2024-09-11T08:13:46.737 INFO:teuthology.orchestra.run.smithi173.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T08:13:46.737 INFO:teuthology.orchestra.run.smithi173.stdout:systemctl: stdout inactive 2024-09-11T08:13:46.738 INFO:teuthology.orchestra.run.smithi173.stdout:firewalld.service is not enabled 2024-09-11T08:13:46.738 INFO:teuthology.orchestra.run.smithi173.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T08:13:46.739 INFO:teuthology.orchestra.run.smithi173.stdout:Ceph Dashboard is now available at: 2024-09-11T08:13:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: URL: https://smithi173.front.sepia.ceph.com:8443/ 2024-09-11T08:13:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: User: admin 2024-09-11T08:13:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: Password: drv0xrkt48 2024-09-11T08:13:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:46.740 INFO:teuthology.orchestra.run.smithi173.stdout:Saving cluster configuration to /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config directory 2024-09-11T08:13:46.740 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling autotune for osd_memory_target 2024-09-11T08:13:47.322 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:47 smithi173 ceph-mon[29664]: mgrmap e13: y(active, since 6s) 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.145+0000 7fe7aa607640 1 Processor -- start 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7aa607640 1 -- start start 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7aa607640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7aa607640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4100ca0 con 0x7fe7a4100350 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55080/0 (socket says 172.21.15.173:55080) 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7a3fff640 1 -- 172.21.15.173:0/1400926819 learned_addr learned my addr 172.21.15.173:0/1400926819 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.146+0000 7fe7a3fff640 1 -- 172.21.15.173:0/1400926819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4100de0 con 0x7fe7a4100350 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7a3fff640 1 --2- 172.21.15.173:0/1400926819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe794009840 tx=0x7fe7940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02ed97d66d8d8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7a2ffd640 1 -- 172.21.15.173:0/1400926819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe79402add0 con 0x7fe7a4100350 2024-09-11T08:13:47.896 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7a2ffd640 1 -- 172.21.15.173:0/1400926819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fe794032880 con 0x7fe7a4100350 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7a2ffd640 1 -- 172.21.15.173:0/1400926819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe794031630 con 0x7fe7a4100350 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7aa607640 1 -- 172.21.15.173:0/1400926819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 msgr2=0x7fe7a4100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.147+0000 7fe7aa607640 1 --2- 172.21.15.173:0/1400926819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe794009840 tx=0x7fe7940091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 -- 172.21.15.173:0/1400926819 shutdown_connections 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 --2- 172.21.15.173:0/1400926819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a4100760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 -- 172.21.15.173:0/1400926819 >> 172.21.15.173:0/1400926819 conn(0x7fe7a40fbb50 msgr2=0x7fe7a40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 -- 172.21.15.173:0/1400926819 shutdown_connections 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 -- 172.21.15.173:0/1400926819 wait complete. 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 Processor -- start 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.148+0000 7fe7aa607640 1 -- start start 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7aa607640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:47.897 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7aa607640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a410f3f0 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55092/0 (socket says 172.21.15.173:55092) 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a3fff640 1 -- 172.21.15.173:0/3477396238 learned_addr learned my addr 172.21.15.173:0/3477396238 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a3fff640 1 -- 172.21.15.173:0/3477396238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009450 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a3fff640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe794006a70 tx=0x7fe794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe794031da0 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fe794031f00 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a410f5f0 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe79403b5c0 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.149+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a410fa60 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.150+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fe794039070 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.150+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a404b720 con 0x7fe7a4100350 2024-09-11T08:13:47.898 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.150+0000 7fe7a0ff9640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 0x7fe79003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.150+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe79406d1d0 con 0x7fe7a4100350 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.151+0000 7fe7a37fe640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 0x7fe79003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.151+0000 7fe7a37fe640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 0x7fe79003ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe78c006fd0 tx=0x7fe78c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.155+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe79403b720 con 0x7fe7a4100350 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.310+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fe7a410fa60 con 0x7fe7a4100350 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.310+0000 7fe7a0ff9640 1 -- 172.21.15.173:0/3477396238 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fe794041020 con 0x7fe7a4100350 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 msgr2=0x7fe79003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 0x7fe79003ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe78c006fd0 tx=0x7fe78c006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 msgr2=0x7fe7a410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe794006a70 tx=0x7fe794008040 comp rx=0 tx=0).stop 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 shutdown_connections 2024-09-11T08:13:47.899 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fe7900395c0 0x7fe79003ba70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:47.900 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 --2- 172.21.15.173:0/3477396238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7a4100350 0x7fe7a410eeb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:47.900 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 >> 172.21.15.173:0/3477396238 conn(0x7fe7a40fbb50 msgr2=0x7fe7a40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:47.900 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.312+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 shutdown_connections 2024-09-11T08:13:47.900 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:47.313+0000 7fe7aa607640 1 -- 172.21.15.173:0/3477396238 wait complete. 2024-09-11T08:13:49.186 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.367+0000 7f8239c03640 1 Processor -- start 2024-09-11T08:13:49.186 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.367+0000 7f8239c03640 1 -- start start 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f8239c03640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f8239c03640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340ffb30 con 0x7f82340ff1e0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f82337fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f82337fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55106/0 (socket says 172.21.15.173:55106) 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f82337fe640 1 -- 172.21.15.173:0/3531013262 learned_addr learned my addr 172.21.15.173:0/3531013262 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.368+0000 7f82337fe640 1 -- 172.21.15.173:0/3531013262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340ffc70 con 0x7f82340ff1e0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.369+0000 7f82337fe640 1 --2- 172.21.15.173:0/3531013262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8224009840 tx=0x7f82240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451587a17ca226a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.369+0000 7f8232ffd640 1 -- 172.21.15.173:0/3531013262 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822402add0 con 0x7f82340ff1e0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.369+0000 7f8232ffd640 1 -- 172.21.15.173:0/3531013262 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f8224032880 con 0x7f82340ff1e0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.369+0000 7f8232ffd640 1 -- 172.21.15.173:0/3531013262 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8224031630 con 0x7f82340ff1e0 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- 172.21.15.173:0/3531013262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 msgr2=0x7f82340ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 --2- 172.21.15.173:0/3531013262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8224009840 tx=0x7f82240091d0 comp rx=0 tx=0).stop 2024-09-11T08:13:49.187 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- 172.21.15.173:0/3531013262 shutdown_connections 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 --2- 172.21.15.173:0/3531013262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f82340ff5f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- 172.21.15.173:0/3531013262 >> 172.21.15.173:0/3531013262 conn(0x7f82340faa00 msgr2=0x7f82340fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- 172.21.15.173:0/3531013262 shutdown_connections 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- 172.21.15.173:0/3531013262 wait complete. 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 Processor -- start 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- start start 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f8239c03640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823410e360 con 0x7f82340ff1e0 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f82337fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f82337fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55112/0 (socket says 172.21.15.173:55112) 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.370+0000 7f82337fe640 1 -- 172.21.15.173:0/283685638 learned_addr learned my addr 172.21.15.173:0/283685638 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f82337fe640 1 -- 172.21.15.173:0/283685638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224009450 con 0x7f82340ff1e0 2024-09-11T08:13:49.188 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f82337fe640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82240319c0 tx=0x7f822402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8224031e50 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f822403b880 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823410e560 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822403a3a0 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.371+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823410efb0 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f8224039070 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f8230ff9640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 0x7f822003ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f822406ca90 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823405ed70 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f822bfff640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 0x7f822003ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.372+0000 7f822bfff640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 0x7f822003ba00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f821c006fd0 tx=0x7f821c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.377+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f822403f080 con 0x7f82340ff1e0 2024-09-11T08:13:49.189 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.612+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f823404b720 con 0x7f82340ff1e0 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.615+0000 7f8230ff9640 1 -- 172.21.15.173:0/283685638 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8224037070 con 0x7f82340ff1e0 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 msgr2=0x7f822003ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 0x7f822003ba00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f821c006fd0 tx=0x7f821c006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 msgr2=0x7f823410de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82240319c0 tx=0x7f822402c040 comp rx=0 tx=0).stop 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 shutdown_connections 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8220039550 0x7f822003ba00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 --2- 172.21.15.173:0/283685638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82340ff1e0 0x7f823410de20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 >> 172.21.15.173:0/283685638 conn(0x7f82340faa00 msgr2=0x7f82340fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 shutdown_connections 2024-09-11T08:13:49.191 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/bin/ceph: stderr 2024-09-11T08:13:48.617+0000 7f8239c03640 1 -- 172.21.15.173:0/283685638 wait complete. 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: ceph telemetry on 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout:For more information see: 2024-09-11T08:13:49.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.193 INFO:teuthology.orchestra.run.smithi173.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-11T08:13:49.193 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:13:49.193 INFO:teuthology.orchestra.run.smithi173.stdout:Bootstrap complete. 2024-09-11T08:13:49.217 INFO:tasks.cephadm:Fetching config... 2024-09-11T08:13:49.217 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:13:49.218 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T08:13:49.234 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T08:13:49.234 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:13:49.234 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T08:13:49.291 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T08:13:49.291 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:13:49.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T08:13:49.355 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T08:13:49.355 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:13:49.355 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T08:13:49.411 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T08:13:49.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChIHIcmMFKckrTSZERhI0mPqklYrI6uvdLU0iHJETAkhQScu/7Yafn9tXPd7TI/2KweAPpjHHLAssVnCVAihRXHSrXlS97+556ZAUzgWVv5QQVfmiI2G43QqND37FpFeAnOVqzNzSbjZdDza5yjzvDHiIPLQt61kbWgbYiCh5kI2sAbHfMGNfiwhnDBvj0oV3dO5DczzJPDwMrJ3OhD8OQMK17+JniJRhz0iPzMMIjWykqxFHPV7qo3FbP0RPvmTXgvN6PLCD3iSkL3qg7PQX0IF3JnrKMnRGR38K/+JjppuEDEM2FSvKftkaddCj8uQKzQ3OdMtXC/uCOTi+LlDWYta7PmGHxuu/8yJY7EaiQIeqOTlmDoAUCEEh1On/V5y7Whm+h99BYZXWnyoBEz3lgggZRLTJ52NcXdyUof+odpXAPDtkQazxQI4OX8pwgPLGx5sZuyJqJhnG+iQzGRix/9peURJPieu7h7Zp8acokeKHo4ckhKAe8sNtpWI93nLM= ceph-4492cbfa-7015-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T08:13:49.485 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChIHIcmMFKckrTSZERhI0mPqklYrI6uvdLU0iHJETAkhQScu/7Yafn9tXPd7TI/2KweAPpjHHLAssVnCVAihRXHSrXlS97+556ZAUzgWVv5QQVfmiI2G43QqND37FpFeAnOVqzNzSbjZdDza5yjzvDHiIPLQt61kbWgbYiCh5kI2sAbHfMGNfiwhnDBvj0oV3dO5DczzJPDwMrJ3OhD8OQMK17+JniJRhz0iPzMMIjWykqxFHPV7qo3FbP0RPvmTXgvN6PLCD3iSkL3qg7PQX0IF3JnrKMnRGR38K/+JjppuEDEM2FSvKftkaddCj8uQKzQ3OdMtXC/uCOTi+LlDWYta7PmGHxuu/8yJY7EaiQIeqOTlmDoAUCEEh1On/V5y7Whm+h99BYZXWnyoBEz3lgggZRLTJ52NcXdyUof+odpXAPDtkQazxQI4OX8pwgPLGx5sZuyJqJhnG+iQzGRix/9peURJPieu7h7Zp8acokeKHo4ckhKAe8sNtpWI93nLM= ceph-4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:13:49.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChIHIcmMFKckrTSZERhI0mPqklYrI6uvdLU0iHJETAkhQScu/7Yafn9tXPd7TI/2KweAPpjHHLAssVnCVAihRXHSrXlS97+556ZAUzgWVv5QQVfmiI2G43QqND37FpFeAnOVqzNzSbjZdDza5yjzvDHiIPLQt61kbWgbYiCh5kI2sAbHfMGNfiwhnDBvj0oV3dO5DczzJPDwMrJ3OhD8OQMK17+JniJRhz0iPzMMIjWykqxFHPV7qo3FbP0RPvmTXgvN6PLCD3iSkL3qg7PQX0IF3JnrKMnRGR38K/+JjppuEDEM2FSvKftkaddCj8uQKzQ3OdMtXC/uCOTi+LlDWYta7PmGHxuu/8yJY7EaiQIeqOTlmDoAUCEEh1On/V5y7Whm+h99BYZXWnyoBEz3lgggZRLTJ52NcXdyUof+odpXAPDtkQazxQI4OX8pwgPLGx5sZuyJqJhnG+iQzGRix/9peURJPieu7h7Zp8acokeKHo4ckhKAe8sNtpWI93nLM= ceph-4492cbfa-7015-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T08:13:49.638 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChIHIcmMFKckrTSZERhI0mPqklYrI6uvdLU0iHJETAkhQScu/7Yafn9tXPd7TI/2KweAPpjHHLAssVnCVAihRXHSrXlS97+556ZAUzgWVv5QQVfmiI2G43QqND37FpFeAnOVqzNzSbjZdDza5yjzvDHiIPLQt61kbWgbYiCh5kI2sAbHfMGNfiwhnDBvj0oV3dO5DczzJPDwMrJ3OhD8OQMK17+JniJRhz0iPzMMIjWykqxFHPV7qo3FbP0RPvmTXgvN6PLCD3iSkL3qg7PQX0IF3JnrKMnRGR38K/+JjppuEDEM2FSvKftkaddCj8uQKzQ3OdMtXC/uCOTi+LlDWYta7PmGHxuu/8yJY7EaiQIeqOTlmDoAUCEEh1On/V5y7Whm+h99BYZXWnyoBEz3lgggZRLTJ52NcXdyUof+odpXAPDtkQazxQI4OX8pwgPLGx5sZuyJqJhnG+iQzGRix/9peURJPieu7h7Zp8acokeKHo4ckhKAe8sNtpWI93nLM= ceph-4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:13:49.652 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T08:13:49.899 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:13:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/283685638' entity='client.admin' 2024-09-11T08:13:51.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 -- 172.21.15.173:0/558134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 msgr2=0x7f4dcc0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:51.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 --2- 172.21.15.173:0/558134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc0fc5c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc004850 tx=0x7f4dbc009da0 comp rx=0 tx=0).stop 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 -- 172.21.15.173:0/558134798 shutdown_connections 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 --2- 172.21.15.173:0/558134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc0fc5c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 -- 172.21.15.173:0/558134798 >> 172.21.15.173:0/558134798 conn(0x7f4dcc0f7990 msgr2=0x7f4dcc0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 -- 172.21.15.173:0/558134798 shutdown_connections 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.924+0000 7f4dd108b640 1 -- 172.21.15.173:0/558134798 wait complete. 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dd108b640 1 Processor -- start 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dd108b640 1 -- start start 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dd108b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dd108b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc10bfb0 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dcad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dcad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55140/0 (socket says 172.21.15.173:55140) 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dcad9d640 1 -- 172.21.15.173:0/199765750 learned_addr learned my addr 172.21.15.173:0/199765750 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dcad9d640 1 -- 172.21.15.173:0/199765750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc005040 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.925+0000 7f4dcad9d640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009040 tx=0x7f4dbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc038070 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f4dbc0098e0 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc10c1b0 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc033420 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc10cd40 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.926+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f4dbc030020 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.927+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc10c680 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.927+0000 7f4dc37fe640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 0x7f4db803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.927+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4dbc06be80 con 0x7f4dcc0fc1b0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.927+0000 7f4dc3fff640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 0x7f4db803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.927+0000 7f4dc3fff640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 0x7f4db803ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4db4006fd0 tx=0x7f4db4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:51.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:51.931+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4dcc10c680 con 0x7f4dcc0fc1b0 2024-09-11T08:13:52.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.093+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f4dcc101930 con 0x7f4dcc0fc1b0 2024-09-11T08:13:52.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.096+0000 7f4dc37fe640 1 -- 172.21.15.173:0/199765750 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4dbc03d8f0 con 0x7f4dcc0fc1b0 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.098+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 msgr2=0x7f4db803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.098+0000 7f4dd108b640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 0x7f4db803ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4db4006fd0 tx=0x7f4db4006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.098+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 msgr2=0x7f4dcc10ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.098+0000 7f4dd108b640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009040 tx=0x7f4dbc009da0 comp rx=0 tx=0).stop 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 shutdown_connections 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4db80395c0 0x7f4db803ba70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:52.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 --2- 172.21.15.173:0/199765750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dcc0fc1b0 0x7f4dcc10ba70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 >> 172.21.15.173:0/199765750 conn(0x7f4dcc0f7990 msgr2=0x7f4dcc0f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 shutdown_connections 2024-09-11T08:13:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:52.099+0000 7f4dd108b640 1 -- 172.21.15.173:0/199765750 wait complete. 2024-09-11T08:13:52.945 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T08:13:52.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T08:13:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/199765750' entity='client.admin' 2024-09-11T08:13:53.622 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:54.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 -- 172.21.15.173:0/2206350020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 msgr2=0x7ff4480fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 --2- 172.21.15.173:0/2206350020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff4480fc5e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff438004850 tx=0x7ff438009da0 comp rx=0 tx=0).stop 2024-09-11T08:13:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 -- 172.21.15.173:0/2206350020 shutdown_connections 2024-09-11T08:13:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 --2- 172.21.15.173:0/2206350020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff4480fc5e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 -- 172.21.15.173:0/2206350020 >> 172.21.15.173:0/2206350020 conn(0x7ff4480f79b0 msgr2=0x7ff4480f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 -- 172.21.15.173:0/2206350020 shutdown_connections 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.980+0000 7ff44e821640 1 -- 172.21.15.173:0/2206350020 wait complete. 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff44e821640 1 Processor -- start 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff44e821640 1 -- start start 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff44e821640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff44e821640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44810bf80 con 0x7ff4480fc1d0 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff447fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff447fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38522/0 (socket says 172.21.15.173:38522) 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.981+0000 7ff447fff640 1 -- 172.21.15.173:0/388833666 learned_addr learned my addr 172.21.15.173:0/388833666 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff447fff640 1 -- 172.21.15.173:0/388833666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438005040 con 0x7ff4480fc1d0 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff447fff640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff438009040 tx=0x7ff438009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438038070 con 0x7ff4480fc1d0 2024-09-11T08:13:54.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7ff4380098e0 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44810c180 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438033420 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.982+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44810cd10 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7ff438030020 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44810c650 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff444ff9640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 0x7ff43003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff43806be30 con 0x7ff4480fc1d0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff4477fe640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 0x7ff43003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.983+0000 7ff4477fe640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 0x7ff43003ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff43c006fd0 tx=0x7ff43c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:54.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:54.987+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff44810c650 con 0x7ff4480fc1d0 2024-09-11T08:13:55.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.145+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff44810c650 con 0x7ff4300395c0 2024-09-11T08:13:55.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.148+0000 7ff444ff9640 1 -- 172.21.15.173:0/388833666 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff44810c650 con 0x7ff4300395c0 2024-09-11T08:13:55.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 msgr2=0x7ff43003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:55.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 0x7ff43003ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff43c006fd0 tx=0x7ff43c006db0 comp rx=0 tx=0).stop 2024-09-11T08:13:55.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 msgr2=0x7ff44810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff438009040 tx=0x7ff438009da0 comp rx=0 tx=0).stop 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 shutdown_connections 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7ff4300395c0 0x7ff43003ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 --2- 172.21.15.173:0/388833666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480fc1d0 0x7ff44810ba40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.150+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 >> 172.21.15.173:0/388833666 conn(0x7ff4480f79b0 msgr2=0x7ff4480f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.151+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 shutdown_connections 2024-09-11T08:13:55.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:55.151+0000 7ff44e821640 1 -- 172.21.15.173:0/388833666 wait complete. 2024-09-11T08:13:55.883 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-09-11T08:13:55.883 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:13:55.883 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-09-11T08:13:55.907 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:13:55.907 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:13:55.976 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-09-11T08:13:55.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch host add smithi175 2024-09-11T08:13:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:13:56.443 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:56.444 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:56 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:13:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 -- 172.21.15.173:0/2102836450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 msgr2=0x7f3eb01004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:13:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/2102836450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb01004c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0004850 tx=0x7f3ea0009da0 comp rx=0 tx=0).stop 2024-09-11T08:13:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 -- 172.21.15.173:0/2102836450 shutdown_connections 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/2102836450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb01004c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 -- 172.21.15.173:0/2102836450 >> 172.21.15.173:0/2102836450 conn(0x7f3eb00717c0 msgr2=0x7f3eb0071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 -- 172.21.15.173:0/2102836450 shutdown_connections 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.821+0000 7f3eb4d65640 1 -- 172.21.15.173:0/2102836450 wait complete. 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eb4d65640 1 Processor -- start 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eb4d65640 1 -- start start 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eb4d65640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eb4d65640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01120a0 con 0x7f3eb01000f0 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eae59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eae59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38544/0 (socket says 172.21.15.173:38544) 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eae59c640 1 -- 172.21.15.173:0/1652825094 learned_addr learned my addr 172.21.15.173:0/1652825094 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:13:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eae59c640 1 -- 172.21.15.173:0/1652825094 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0005040 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.822+0000 7f3eae59c640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009040 tx=0x7f3ea0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea0038070 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f3ea0009730 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb0112300 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea003de40 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb0112750 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.823+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f3ea0030020 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.824+0000 7f3ea6ffd640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 0x7f3e9c03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.824+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3ea006c650 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.824+0000 7f3eadd9b640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 0x7f3e9c03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.824+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb00fc970 con 0x7f3eb01000f0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.824+0000 7f3eadd9b640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 0x7f3e9c03ba00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e98006fd0 tx=0x7f3e98006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:13:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.828+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3ea0033470 con 0x7f3eb01000f0 2024-09-11T08:13:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:13:57.992+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eb01046f0 con 0x7f3e9c039550 2024-09-11T08:13:59.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:58 smithi173 ceph-mon[29664]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:13:59 smithi173 ceph-mon[29664]: Deploying cephadm binary to smithi175 2024-09-11T08:14:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.757+0000 7f3ea6ffd640 1 -- 172.21.15.173:0/1652825094 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3eb01046f0 con 0x7f3e9c039550 2024-09-11T08:14:00.759 INFO:teuthology.orchestra.run.smithi173.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-09-11T08:14:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.759+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 msgr2=0x7f3e9c03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.759+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 0x7f3e9c03ba00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e98006fd0 tx=0x7f3e98006db0 comp rx=0 tx=0).stop 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.759+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 msgr2=0x7f3eb0111b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.759+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009040 tx=0x7f3ea0009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 shutdown_connections 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f3e9c039550 0x7f3e9c03ba00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 --2- 172.21.15.173:0/1652825094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb01000f0 0x7f3eb0111b60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 >> 172.21.15.173:0/1652825094 conn(0x7f3eb00717c0 msgr2=0x7f3eb00ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 shutdown_connections 2024-09-11T08:14:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:00.760+0000 7f3eb4d65640 1 -- 172.21.15.173:0/1652825094 wait complete. 2024-09-11T08:14:01.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T08:14:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: Added host smithi175 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:01.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.122+0000 7f685a12a640 1 -- 172.21.15.173:0/735373338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 msgr2=0x7f68541014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.122+0000 7f685a12a640 1 --2- 172.21.15.173:0/735373338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541014b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6844004850 tx=0x7f6844009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- 172.21.15.173:0/735373338 shutdown_connections 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 --2- 172.21.15.173:0/735373338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541014b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- 172.21.15.173:0/735373338 >> 172.21.15.173:0/735373338 conn(0x7f68540710b0 msgr2=0x7f68540714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- 172.21.15.173:0/735373338 shutdown_connections 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- 172.21.15.173:0/735373338 wait complete. 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 Processor -- start 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- start start 2024-09-11T08:14:03.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.123+0000 7f685a12a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854110f00 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f68537fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f68537fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60522/0 (socket says 172.21.15.173:60522) 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f68537fe640 1 -- 172.21.15.173:0/1415293177 learned_addr learned my addr 172.21.15.173:0/1415293177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f68537fe640 1 -- 172.21.15.173:0/1415293177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844005040 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f68537fe640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6844000c00 tx=0x7f6844009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f684403a070 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6854111100 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f6844009890 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68440335c0 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.124+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68541115d0 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.125+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f6844030020 con 0x7f68541010e0 2024-09-11T08:14:03.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.125+0000 7f683bfff640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 0x7f683c03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:03.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.125+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68541115d0 con 0x7f68541010e0 2024-09-11T08:14:03.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.125+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f684406e300 con 0x7f68541010e0 2024-09-11T08:14:03.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.125+0000 7f6852ffd640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 0x7f683c03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:03.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.126+0000 7f6852ffd640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 0x7f683c03ba00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6848006fd0 tx=0x7f6848006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:03.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.130+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f68541115d0 con 0x7f68541010e0 2024-09-11T08:14:03.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.289+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68541115d0 con 0x7f683c039550 2024-09-11T08:14:03.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.291+0000 7f683bfff640 1 -- 172.21.15.173:0/1415293177 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f68541115d0 con 0x7f683c039550 2024-09-11T08:14:03.292 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:14:03.293 INFO:teuthology.orchestra.run.smithi173.stdout:[{"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-09-11T08:14:03.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 msgr2=0x7f683c03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:03.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 0x7f683c03ba00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6848006fd0 tx=0x7f6848006db0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 msgr2=0x7f68541109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6844000c00 tx=0x7f6844009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 shutdown_connections 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f683c039550 0x7f683c03ba00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 --2- 172.21.15.173:0/1415293177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541010e0 0x7f68541109c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.292+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 >> 172.21.15.173:0/1415293177 conn(0x7f68540710b0 msgr2=0x7f68540fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.293+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 shutdown_connections 2024-09-11T08:14:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:03.293+0000 7f685a12a640 1 -- 172.21.15.173:0/1415293177 wait complete. 2024-09-11T08:14:03.304 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:03 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:03.304 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:03 smithi173 ceph-mon[29664]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:03.915 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T08:14:03.915 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T08:14:04.149 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:04 smithi173 ceph-mon[29664]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2271464024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 msgr2=0x7fd7841025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2271464024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd7841025b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd774004850 tx=0x7fd774009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2271464024 shutdown_connections 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2271464024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd7841025b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2271464024 >> 172.21.15.173:0/2271464024 conn(0x7fd7840710b0 msgr2=0x7fd7840714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2271464024 shutdown_connections 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2271464024 wait complete. 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 Processor -- start 2024-09-11T08:14:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 -- start start 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.703+0000 7fd78a8a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd78a8a9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784112040 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd783fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd783fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60544/0 (socket says 172.21.15.173:60544) 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd783fff640 1 -- 172.21.15.173:0/2334679018 learned_addr learned my addr 172.21.15.173:0/2334679018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd783fff640 1 -- 172.21.15.173:0/2334679018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774005040 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd783fff640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd774004820 tx=0x7fd774009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd774038070 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fd774009790 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7740323d0 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd784112240 con 0x7fd7841021e0 2024-09-11T08:14:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.704+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd784112710 con 0x7fd7841021e0 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.705+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fd774030020 con 0x7fd7841021e0 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.705+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7840fd950 con 0x7fd7841021e0 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.705+0000 7fd7817fa640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 0x7fd77003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.706+0000 7fd77bfff640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 0x7fd77003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.706+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd77406bc20 con 0x7fd7841021e0 2024-09-11T08:14:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.706+0000 7fd77bfff640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 0x7fd77003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006fd0 tx=0x7fd76c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:05.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.710+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd77403b500 con 0x7fd7841021e0 2024-09-11T08:14:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:05.874+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd784112710 con 0x7fd7841021e0 2024-09-11T08:14:06.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.732+0000 7fd7817fa640 1 -- 172.21.15.173:0/2334679018 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd784112710 con 0x7fd7841021e0 2024-09-11T08:14:06.734 INFO:teuthology.orchestra.run.smithi173.stderr:adjusted tunables profile to default 2024-09-11T08:14:06.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 msgr2=0x7fd77003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:06.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 0x7fd77003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006fd0 tx=0x7fd76c006db0 comp rx=0 tx=0).stop 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 msgr2=0x7fd784111b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd774004820 tx=0x7fd774009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 shutdown_connections 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd7700395c0 0x7fd77003ba70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 --2- 172.21.15.173:0/2334679018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7841021e0 0x7fd784111b00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.734+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 >> 172.21.15.173:0/2334679018 conn(0x7fd7840710b0 msgr2=0x7fd7840fa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.735+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 shutdown_connections 2024-09-11T08:14:06.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:06.735+0000 7fd78a8a9640 1 -- 172.21.15.173:0/2334679018 wait complete. 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:06.986 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2334679018' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T08:14:07.264 INFO:tasks.cephadm:Adding mon.a on smithi173 2024-09-11T08:14:07.264 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-09-11T08:14:07.264 INFO:tasks.cephadm:Adding mon.b on smithi175 2024-09-11T08:14:07.264 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b' 2024-09-11T08:14:07.506 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:07 smithi173 ceph-mon[29664]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2334679018' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T08:14:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:07 smithi173 ceph-mon[29664]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 -- 172.21.15.175:0/763050679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 msgr2=0x7f7d201025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 --2- 172.21.15.175:0/763050679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d201025b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009bd0 tx=0x7f7d10004d10 comp rx=0 tx=0).stop 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 -- 172.21.15.175:0/763050679 shutdown_connections 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 --2- 172.21.15.175:0/763050679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d201025b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 -- 172.21.15.175:0/763050679 >> 172.21.15.175:0/763050679 conn(0x7f7d200f7d90 msgr2=0x7f7d200fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 -- 172.21.15.175:0/763050679 shutdown_connections 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.120+0000 7f7d259fd640 1 -- 172.21.15.175:0/763050679 wait complete. 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.121+0000 7f7d259fd640 1 Processor -- start 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.121+0000 7f7d259fd640 1 -- start start 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.121+0000 7f7d259fd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d259fd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d201120a0 con 0x7f7d201021e0 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d1effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d1effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.175:47962/0 (socket says 172.21.15.175:47962) 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d1effd640 1 -- 172.21.15.175:0/4027201614 learned_addr learned my addr 172.21.15.175:0/4027201614 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d1effd640 1 -- 172.21.15.175:0/4027201614 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100098b0 con 0x7f7d201021e0 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d1effd640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ba0 tx=0x7f7d10004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d10032640 con 0x7f7d201021e0 2024-09-11T08:14:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f7d10032be0 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d201122a0 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d1003d9f0 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.122+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d201126f0 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.123+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d200fd950 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.124+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f7d1002f030 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.124+0000 7f7d177fe640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 0x7f7d0c03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.124+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7d1006d490 con 0x7f7d201021e0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.124+0000 7f7d1e7fc640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 0x7f7d0c03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.124+0000 7f7d1e7fc640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 0x7f7d0c03ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7d08006fd0 tx=0x7f7d08006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:09.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.129+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7d1004e530 con 0x7f7d201021e0 2024-09-11T08:14:09.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.292+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d20105800 con 0x7f7d0c039550 2024-09-11T08:14:09.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.298+0000 7f7d177fe640 1 -- 172.21.15.175:0/4027201614 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7d20105800 con 0x7f7d0c039550 2024-09-11T08:14:09.299 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 msgr2=0x7f7d0c03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 0x7f7d0c03ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7d08006fd0 tx=0x7f7d08006db0 comp rx=0 tx=0).stop 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 msgr2=0x7f7d20111b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009ba0 tx=0x7f7d10004d10 comp rx=0 tx=0).stop 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 shutdown_connections 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f7d0c039550 0x7f7d0c03ba00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 --2- 172.21.15.175:0/4027201614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d201021e0 0x7f7d20111b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 >> 172.21.15.175:0/4027201614 conn(0x7f7d200f7d90 msgr2=0x7f7d200f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:09.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 shutdown_connections 2024-09-11T08:14:09.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:09.300+0000 7f7d259fd640 1 -- 172.21.15.175:0/4027201614 wait complete. 2024-09-11T08:14:09.885 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T08:14:09.888 DEBUG:teuthology.orchestra.run.smithi175:mon.b> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T08:14:09.890 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T08:14:09.891 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T08:14:10.019 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:10.019 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:10.019 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:10.019 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:10.020 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:10.020 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:10.020 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:10.020 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:10.999 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:11.031 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:10 smithi173 ceph-mon[29664]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:11.031 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:10 smithi173 ceph-mon[29664]: Saving service mon spec with placement smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b;count:3 2024-09-11T08:14:11.031 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:10 smithi173 ceph-mon[29664]: Deploying daemon mon.b on smithi175 2024-09-11T08:14:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:11 smithi173 ceph-mon[29664]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2027658817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 msgr2=0x7fdb7c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2027658817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c1025b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb70004850 tx=0x7fdb70009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2027658817 shutdown_connections 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2027658817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c1025b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2027658817 >> 172.21.15.175:0/2027658817 conn(0x7fdb7c0f7d90 msgr2=0x7fdb7c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2027658817 shutdown_connections 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.870+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2027658817 wait complete. 2024-09-11T08:14:13.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.871+0000 7fdb82fbc640 1 Processor -- start 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.871+0000 7fdb82fbc640 1 -- start start 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.871+0000 7fdb82fbc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.871+0000 7fdb82fbc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1120a0 con 0x7fdb7c1021e0 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb80d58640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb80d58640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.175:47974/0 (socket says 172.21.15.175:47974) 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb80d58640 1 -- 172.21.15.175:0/2453307675 learned_addr learned my addr 172.21.15.175:0/2453307675 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb80d58640 1 -- 172.21.15.175:0/2453307675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70005040 con 0x7fdb7c1021e0 2024-09-11T08:14:13.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb80d58640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb70004820 tx=0x7fdb70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb70038070 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fdb70009790 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb700323d0 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c1122a0 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.872+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c1126f0 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.873+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fdb70030020 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.873+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c0fd950 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.873+0000 7fdb797fa640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 0x7fdb6c03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.873+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdb7006bf10 con 0x7fdb7c1021e0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.874+0000 7fdb7bfff640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 0x7fdb6c03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:13.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.874+0000 7fdb7bfff640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 0x7fdb6c03ba00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006fd0 tx=0x7fdb68006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:13.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:13.878+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdb70033420 con 0x7fdb7c1021e0 2024-09-11T08:14:14.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.107+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdb7c05ed70 con 0x7fdb7c1021e0 2024-09-11T08:14:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.108+0000 7fdb797fa640 1 -- 172.21.15.175:0/2453307675 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fdb7003c380 con 0x7fdb7c1021e0 2024-09-11T08:14:14.109 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:14:14.109 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","modified":"2024-09-11T08:12:45.918947Z","created":"2024-09-11T08:12:45.918947Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T08:14:14.109 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 msgr2=0x7fdb6c03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 0x7fdb6c03ba00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006fd0 tx=0x7fdb68006db0 comp rx=0 tx=0).stop 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 msgr2=0x7fdb7c111b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb70004820 tx=0x7fdb70009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 shutdown_connections 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdb6c039550 0x7fdb6c03ba00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 --2- 172.21.15.175:0/2453307675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb7c1021e0 0x7fdb7c111b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:14.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 >> 172.21.15.175:0/2453307675 conn(0x7fdb7c0f7d90 msgr2=0x7fdb7c0f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:14.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 shutdown_connections 2024-09-11T08:14:14.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:14.110+0000 7fdb82fbc640 1 -- 172.21.15.175:0/2453307675 wait complete. 2024-09-11T08:14:14.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:13 smithi173 ceph-mon[29664]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:16.016 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T08:14:16.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T08:14:16.270 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:14:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:19 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:19.945 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:19.945 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:14:19.945 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.945 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: mon.a calling monitor election 2024-09-11T08:14:19.945 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: mon.b calling monitor election 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: monmap e2: 2 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0],b=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: fsmap 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: mgrmap e13: y(active, since 39s) 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: overall HEALTH_OK 2024-09-11T08:14:19.946 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:19.947 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:19.947 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:19.947 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:19.947 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:20.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3555515647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc0034f0 msgr2=0x7fb2cc005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:20.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3555515647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc0034f0 0x7fb2cc005970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0065790 tx=0x7fb2dc00b040 comp rx=0 tx=0).stop 2024-09-11T08:14:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3555515647 shutdown_connections 2024-09-11T08:14:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3555515647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2cc0034f0 0x7fb2cc005970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3555515647 >> 172.21.15.175:0/3555515647 conn(0x7fb2e00f6e00 msgr2=0x7fb2e00f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3555515647 shutdown_connections 2024-09-11T08:14:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.836+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3555515647 wait complete. 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 Processor -- start 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 -- start start 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 0x7fb2e00fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00fc0d0 con 0x7fb2e00fb740 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.837+0000 7fb2e7ad4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0118110 con 0x7fb2cc0034f0 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49924/0 (socket says 172.21.15.175:49924) 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 -- 172.21.15.175:0/3362516053 learned_addr learned my addr 172.21.15.175:0/3362516053 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:14:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e506f640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 0x7fb2e00fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 -- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 msgr2=0x7fb2e00fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 -- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 msgr2=0x7fb2e00fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e5870640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e506f640 1 -- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 msgr2=0x7fb2e00fb200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e506f640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e506f640 1 -- 172.21.15.175:0/3362516053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc005040 con 0x7fb2e00fb740 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e506f640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 0x7fb2e00fbb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b5b0 tx=0x7fb2d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb2d0010820 con 0x7fb2e00fb740 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fb2d0010dc0 con 0x7fb2e00fb740 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.838+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e0118370 con 0x7fb2e00fb740 2024-09-11T08:14:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.839+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb2d000fc10 con 0x7fb2e00fb740 2024-09-11T08:14:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.839+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e0118890 con 0x7fb2e00fb740 2024-09-11T08:14:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.839+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fb2d000d370 con 0x7fb2e00fb740 2024-09-11T08:14:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.840+0000 7fb2d67fc640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 0x7fb2c403bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:20.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.840+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb2d004bf70 con 0x7fb2e00fb740 2024-09-11T08:14:20.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.840+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0065f90 con 0x7fb2e00fb740 2024-09-11T08:14:20.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.840+0000 7fb2e5870640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 0x7fb2c403bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:20.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.841+0000 7fb2e5870640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 0x7fb2c403bba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007b40 tx=0x7fb2dc00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:20 smithi175 ceph-mon[32813]: Deploying daemon mon.c on smithi173 2024-09-11T08:14:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:20 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:20.845+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb2d0017360 con 0x7fb2e00fb740 2024-09-11T08:14:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:20 smithi173 ceph-mon[29664]: Deploying daemon mon.c on smithi173 2024-09-11T08:14:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:20 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:21.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.073+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb2e0103330 con 0x7fb2e00fb740 2024-09-11T08:14:21.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.073+0000 7fb2d67fc640 1 -- 172.21.15.175:0/3362516053 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1005 (secure 0 0 0) 0x7fb2d000e340 con 0x7fb2e00fb740 2024-09-11T08:14:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:14:21.075 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","modified":"2024-09-11T08:14:14.521445Z","created":"2024-09-11T08:12:45.918947Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T08:14:21.075 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-11T08:14:21.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 msgr2=0x7fb2c403bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:21.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 0x7fb2c403bba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007b40 tx=0x7fb2dc00b040 comp rx=0 tx=0).stop 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 msgr2=0x7fb2e00fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 0x7fb2e00fbb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b5b0 tx=0x7fb2d00090f0 comp rx=0 tx=0).stop 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 shutdown_connections 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fb2c40396f0 0x7fb2c403bba0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2e00fb740 0x7fb2e00fbb90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 --2- 172.21.15.175:0/3362516053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2cc0034f0 0x7fb2e00fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.075+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 >> 172.21.15.175:0/3362516053 conn(0x7fb2e00f6e00 msgr2=0x7fb2e00fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.076+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 shutdown_connections 2024-09-11T08:14:21.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:21.076+0000 7fb2e7ad4640 1 -- 172.21.15.175:0/3362516053 wait complete. 2024-09-11T08:14:21.639 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:21 smithi175 ceph-mon[32813]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:21.639 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3362516053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:21 smithi173 ceph-mon[29664]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3362516053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:22.661 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T08:14:22.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T08:14:22.674 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 podman[40796]: 2024-09-11 08:14:22.674248747 +0000 UTC m=+0.144090671 container create d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T08:14:22.904 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:14:22.952 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 podman[40796]: 2024-09-11 08:14:22.868153424 +0000 UTC m=+0.337995349 container init d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.build-date=20240731) 2024-09-11T08:14:22.952 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 podman[40796]: 2024-09-11 08:14:22.872939598 +0000 UTC m=+0.342781527 container start d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T08:14:22.952 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T08:14:22.952 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: ceph version 17.2.7-1623-gd0e6828a (d0e6828a2016d48cf25ad84064e50742bb1c39b9) quincy (stable), process ceph-mon, pid 7 2024-09-11T08:14:22.952 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pidfile_write: ignore empty --pid-file 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: load: jerasure load: lrc 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: RocksDB version: 6.15.5 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Compile date Sep 10 2024 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: DB SUMMARY 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: DB Session ID: OPHW6S6JIG9EZKUQLG48 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: CURRENT file: CURRENT 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.error_if_exists: 0 2024-09-11T08:14:22.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.create_if_missing: 0 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.paranoid_checks: 1 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.env: 0x55bf015d8440 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.fs: Posix File System 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.info_log: 0x55bf02586ec0 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T08:14:22.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.statistics: (nil) 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.use_fsync: 0 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_log_file_size: 0 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_fallocate: 1 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T08:14:22.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.use_direct_reads: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.db_log_dir: 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T08:14:22.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.write_buffer_manager: 0x55bf026447b0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.unordered_write: 0 2024-09-11T08:14:22.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.row_cache: None 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.wal_filter: None 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.preserve_deletes: 0 2024-09-11T08:14:22.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.two_write_queues: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.atomic_flush: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.log_readahead_size: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T08:14:22.959 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_background_jobs: 2 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_background_compactions: -1 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_subcompactions: 1 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_open_files: -1 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T08:14:22.960 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_background_flushes: -1 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Compression algorithms supported: 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kZSTD supported: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kXpressCompression supported: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kBZip2Compression supported: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kLZ4Compression supported: 1 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kZlibCompression supported: 1 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: kSnappyCompression supported: 1 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T08:14:22.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.merge_operator: 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_filter: None 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bf0252da38) 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T08:14:22.962 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: hash_index_allow_collision: 1 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 1 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x55bf025631f0 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2024-09-11T08:14:22.963 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2024-09-11T08:14:22.964 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 4 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression: NoCompression 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.num_levels: 7 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T08:14:22.965 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T08:14:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T08:14:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T08:14:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T08:14:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T08:14:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T08:14:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T08:14:22.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.arena_block_size: 4194304 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T08:14:22.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.inplace_update_support: 0 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T08:14:22.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.bloom_locality: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.max_successive_merges: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.ttl: 2592000 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.enable_blob_files: false 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.min_blob_size: 0 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T08:14:22.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042462896435, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042462896725, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1696, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726042462, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "12d536d9-ad93-4a63-ab39-f3279b10aa41", "db_session_id": "OPHW6S6JIG9EZKUQLG48"}} 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726042462897063, "job": 1, "event": "recovery_finished"} 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55bf02596700 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: DB pointer 0x55bf02566000 2024-09-11T08:14:22.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:14:22.973 INFO:journalctl@ceph.mon.c.smithi173.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.66 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.66 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T08:14:22.974 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.66 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.66 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-11T08:14:22.975 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.8 0.00 0.00 1 0.000 0 0 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:14:22.976 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: using public_addrv [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] at bind addrs [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(???) e0 preinit fsid 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).mds e1 new map 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2024-09-11T08:14:22.977 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2334679018' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T08:14:22.978 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: Saving service mon spec with placement smithi173:172.21.15.173=a;smithi173:[v2:172.21.15.173:3301,v1:172.21.15.173:6790]=c;smithi175:172.21.15.175=b;count:3 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: Deploying daemon mon.b on smithi175 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.979 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.a calling monitor election 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.b calling monitor election 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.980 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: monmap e2: 2 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0],b=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: fsmap 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mgrmap e13: y(active, since 39s) 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: overall HEALTH_OK 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: Deploying daemon mon.c on smithi173 2024-09-11T08:14:22.981 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:22.982 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:22.982 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3362516053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:22.982 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 ceph-mon[40835]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T08:14:22.982 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 bash[40796]: d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 2024-09-11T08:14:22.982 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:22 smithi173 systemd[1]: Started Ceph mon.c for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 -- 172.21.15.175:0/3870615986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd400034f0 msgr2=0x7efd40005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 --2- 172.21.15.175:0/3870615986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd400034f0 0x7efd40005970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd540fd7b0 tx=0x7efd4c009040 comp rx=0 tx=0).stop 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 -- 172.21.15.175:0/3870615986 shutdown_connections 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 --2- 172.21.15.175:0/3870615986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd400034f0 0x7efd40005970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 -- 172.21.15.175:0/3870615986 >> 172.21.15.175:0/3870615986 conn(0x7efd540f7ec0 msgr2=0x7efd540fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 -- 172.21.15.175:0/3870615986 shutdown_connections 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.017+0000 7efd5af6a640 1 -- 172.21.15.175:0/3870615986 wait complete. 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.018+0000 7efd5af6a640 1 Processor -- start 2024-09-11T08:14:28.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.018+0000 7efd5af6a640 1 -- start start 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54114a60 con 0x7efd5410e3b0 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5411ad40 con 0x7efd541143f0 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd5af6a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5411ae80 con 0x7efd400034f0 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:28.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd58d06640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.175:59682/0 (socket says 172.21.15.175:59682) 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 -- 172.21.15.175:0/1896480772 learned_addr learned my addr 172.21.15.175:0/1896480772 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38614/0 (socket says 172.21.15.175:38614) 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd58d06640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 msgr2=0x7efd54113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd58d06640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 msgr2=0x7efd54113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd58d06640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 msgr2=0x7efd5410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 msgr2=0x7efd5410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd58d06640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd53fff640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 msgr2=0x7efd54113eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:14:28.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 msgr2=0x7efd5410de70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 -- 172.21.15.175:0/1896480772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c007990 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.019+0000 7efd59507640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd4400b5e0 tx=0x7efd440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.020+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4400f590 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.020+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7efd4400fb30 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.020+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5411b0e0 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.020+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44010a60 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.020+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5411b5b0 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.021+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7efd4401a460 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.021+0000 7efd517fa640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 0x7efd3403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.021+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd540fda60 con 0x7efd5410e3b0 2024-09-11T08:14:28.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.021+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efd4404c920 con 0x7efd5410e3b0 2024-09-11T08:14:28.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.021+0000 7efd58d06640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 0x7efd3403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:28.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.022+0000 7efd58d06640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 0x7efd3403bee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001220 tx=0x7efd4c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:28.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.026+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efd4400ea80 con 0x7efd5410e3b0 2024-09-11T08:14:28.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.256+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efd5405ed70 con 0x7efd5410e3b0 2024-09-11T08:14:28.259 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:14:28.259 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: mon.a calling monitor election 2024-09-11T08:14:28.259 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: mon.b calling monitor election 2024-09-11T08:14:28.259 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:28.259 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: mon.c calling monitor election 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: monmap e3: 3 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0],b=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0],c=[v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: fsmap 2024-09-11T08:14:28.260 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: mgrmap e13: y(active, since 47s) 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: overall HEALTH_OK 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.261 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.257+0000 7efd517fa640 1 -- 172.21.15.175:0/1896480772 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1275 (secure 0 0 0) 0x7efd4400e660 con 0x7efd5410e3b0 2024-09-11T08:14:28.262 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T08:14:28.262 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","modified":"2024-09-11T08:14:22.919813Z","created":"2024-09-11T08:12:45.918947Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3301","nonce":0},{"type":"v1","addr":"172.21.15.173:6790","nonce":0}]},"addr":"172.21.15.173:6790/0","public_addr":"172.21.15.173:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 msgr2=0x7efd3403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 0x7efd3403bee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001220 tx=0x7efd4c009040 comp rx=0 tx=0).stop 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 msgr2=0x7efd5410e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd4400b5e0 tx=0x7efd440090f0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 shutdown_connections 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5410e3b0 0x7efd5410e850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd541143f0 0x7efd5410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efd34039a30 0x7efd3403bee0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 --2- 172.21.15.175:0/1896480772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400034f0 0x7efd54113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 >> 172.21.15.175:0/1896480772 conn(0x7efd540f7ec0 msgr2=0x7efd5406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 shutdown_connections 2024-09-11T08:14:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:28.260+0000 7efd5af6a640 1 -- 172.21.15.175:0/1896480772 wait complete. 2024-09-11T08:14:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:14:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: mon.a calling monitor election 2024-09-11T08:14:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: mon.b calling monitor election 2024-09-11T08:14:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: mon.c calling monitor election 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: monmap e3: 3 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0],b=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0],c=[v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: fsmap 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:28.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: mgrmap e13: y(active, since 47s) 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: overall HEALTH_OK 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: mon.a calling monitor election 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: mon.b calling monitor election 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: mon.c calling monitor election 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: monmap e3: 3 mons at {a=[v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0],b=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0],c=[v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: fsmap 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: mgrmap e13: y(active, since 47s) 2024-09-11T08:14:28.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: overall HEALTH_OK 2024-09-11T08:14:28.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:28.824 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T08:14:28.824 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T08:14:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:28 smithi175 ceph-mon[32813]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/1896480772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:29.114 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[29664]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/1896480772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[40835]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/1896480772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T08:14:29.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:14:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:31.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- 172.21.15.173:0/2376037568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 msgr2=0x7fdfc01014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:31.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2376037568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc01014b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0004850 tx=0x7fdfb0009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- 172.21.15.173:0/2376037568 shutdown_connections 2024-09-11T08:14:31.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2376037568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc01014b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- 172.21.15.173:0/2376037568 >> 172.21.15.173:0/2376037568 conn(0x7fdfc00710b0 msgr2=0x7fdfc00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- 172.21.15.173:0/2376037568 shutdown_connections 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- 172.21.15.173:0/2376037568 wait complete. 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 Processor -- start 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.954+0000 7fdfc6945640 1 -- start start 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc010d310 0x7fdfc010d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfc0115e40 0x7fdfc0118220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01189b0 con 0x7fdfc01010e0 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0118b20 con 0x7fdfc010d310 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0118ce0 con 0x7fdfc0115e40 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60108/0 (socket says 172.21.15.173:60108) 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 -- 172.21.15.173:0/2408196873 learned_addr learned my addr 172.21.15.173:0/2408196873 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc4ee2640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfc0115e40 0x7fdfc0118220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 -- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfc0115e40 msgr2=0x7fdfc0118220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfc0115e40 0x7fdfc0118220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 -- 172.21.15.173:0/2408196873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc010d310 msgr2=0x7fdfc010d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc010d310 0x7fdfc010d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 -- 172.21.15.173:0/2408196873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0005040 con 0x7fdfc01010e0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbffff640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009040 tx=0x7fdfb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00325e0 con 0x7fdfc01010e0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0118f60 con 0x7fdfc01010e0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fdfb0032b80 con 0x7fdfc01010e0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0033840 con 0x7fdfc01010e0 2024-09-11T08:14:31.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.955+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc0119480 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.956+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fdfb0030020 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.956+0000 7fdfbcff9640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 0x7fdfac03be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.956+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdfb006c4d0 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.957+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00fc850 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.957+0000 7fdfbf7fe640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 0x7fdfac03be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.957+0000 7fdfbf7fe640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 0x7fdfac03be90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8006fd0 tx=0x7fdfa8006d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:30.961+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdfb0042a60 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.126+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fdfc0065140 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.126+0000 7fdfbcff9640 1 -- 172.21.15.173:0/2408196873 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fdfb000a000 con 0x7fdfc01010e0 2024-09-11T08:14:31.390 INFO:teuthology.orchestra.run.smithi173.stdout:# minimal ceph.conf for 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stdout: mon_host = [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.128+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 msgr2=0x7fdfac03be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.128+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 0x7fdfac03be90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8006fd0 tx=0x7fdfa8006d50 comp rx=0 tx=0).stop 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.128+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 msgr2=0x7fdfc010cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.128+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009040 tx=0x7fdfb0009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 shutdown_connections 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fdfac0399e0 0x7fdfac03be90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfc0115e40 0x7fdfc0118220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc010d310 0x7fdfc010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 --2- 172.21.15.173:0/2408196873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfc01010e0 0x7fdfc010cdd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:31.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 >> 172.21.15.173:0/2408196873 conn(0x7fdfc00710b0 msgr2=0x7fdfc0103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:31.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 shutdown_connections 2024-09-11T08:14:31.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:31.129+0000 7fdfc6945640 1 -- 172.21.15.173:0/2408196873 wait complete. 2024-09-11T08:14:31.392 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.392 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.392 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T08:14:31.392 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:31.392 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: Reconfiguring daemon mon.a on smithi173 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408196873' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: Reconfiguring daemon mon.a on smithi173 2024-09-11T08:14:31.394 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:31.394 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:31.394 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408196873' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: Reconfiguring daemon mon.a on smithi173 2024-09-11T08:14:31.589 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:31.590 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:31.590 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408196873' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:31.889 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T08:14:31.889 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:14:31.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T08:14:31.916 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:14:31.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:14:31.982 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:14:31.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T08:14:32.015 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:14:32.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:14:32.087 INFO:tasks.cephadm:Adding mgr.y on smithi173 2024-09-11T08:14:32.088 INFO:tasks.cephadm:Adding mgr.x on smithi175 2024-09-11T08:14:32.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply mgr '2;smithi173=y;smithi175=x' 2024-09-11T08:14:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: Reconfiguring mon.c (monmap changed)... 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[40835]: Reconfiguring daemon mon.c on smithi173 2024-09-11T08:14:33.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: Reconfiguring mon.c (monmap changed)... 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:33.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:33 smithi173 ceph-mon[29664]: Reconfiguring daemon mon.c on smithi173 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: Reconfiguring mon.c (monmap changed)... 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:33.546 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:33 smithi175 ceph-mon[32813]: Reconfiguring daemon mon.c on smithi173 2024-09-11T08:14:33.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- 172.21.15.175:0/1464137220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 msgr2=0x7fa8f40fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:33.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/1464137220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f40fb600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004850 tx=0x7fa8e4009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:33.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- 172.21.15.175:0/1464137220 shutdown_connections 2024-09-11T08:14:33.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/1464137220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f40fb600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:33.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- 172.21.15.175:0/1464137220 >> 172.21.15.175:0/1464137220 conn(0x7fa8f40f69b0 msgr2=0x7fa8f40f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- 172.21.15.175:0/1464137220 shutdown_connections 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- 172.21.15.175:0/1464137220 wait complete. 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 Processor -- start 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.877+0000 7fa8fc58e640 1 -- start start 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 0x7fa8f410c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8f410c590 0x7fa8f410ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f410b8e0 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f41132a0 con 0x7fa8f410b2c0 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4113460 con 0x7fa8f410c590 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8f9b29640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 0x7fa8f410c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:33.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.175:59700/0 (socket says 172.21.15.175:59700) 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 -- 172.21.15.175:0/2839420746 learned_addr learned my addr 172.21.15.175:0/2839420746 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8f9b29640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 0x7fa8f410c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38626/0 (socket says 172.21.15.175:38626) 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fab2b640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8f410c590 0x7fa8f410ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 -- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8f410c590 msgr2=0x7fa8f410ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8f410c590 0x7fa8f410ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 -- 172.21.15.175:0/2839420746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 msgr2=0x7fa8f410c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 0x7fa8f410c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 -- 172.21.15.175:0/2839420746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4005040 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fa32a640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004820 tx=0x7fa8e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4009850 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f41136e0 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fa8e4032c30 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.878+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e403b9b0 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.879+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4113c80 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.879+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7fa8e4030020 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.880+0000 7fa8eaffd640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 0x7fa8e003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.880+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa8e406c0c0 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.880+0000 7fa8f9b29640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 0x7fa8e003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.880+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4100970 con 0x7fa8f40fb1f0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.880+0000 7fa8f9b29640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 0x7fa8e003bee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009b80 tx=0x7fa8f00090f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:33.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:33.885+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa8e403ab40 con 0x7fa8f40fb1f0 2024-09-11T08:14:34.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.059+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi173=y;smithi175=x", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8f41001c0 con 0x7fa8e0039a30 2024-09-11T08:14:34.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.064+0000 7fa8eaffd640 1 -- 172.21.15.175:0/2839420746 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa8f41001c0 con 0x7fa8e0039a30 2024-09-11T08:14:34.066 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-09-11T08:14:34.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 msgr2=0x7fa8e003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:34.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 0x7fa8e003bee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009b80 tx=0x7fa8f00090f0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 msgr2=0x7fa8f410ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:34.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004820 tx=0x7fa8e4009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 shutdown_connections 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa8e0039a30 0x7fa8e003bee0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8f410c590 0x7fa8f410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8f410b2c0 0x7fa8f410c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 --2- 172.21.15.175:0/2839420746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8f40fb1f0 0x7fa8f410ad80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 >> 172.21.15.175:0/2839420746 conn(0x7fa8f40f69b0 msgr2=0x7fa8f40f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 shutdown_connections 2024-09-11T08:14:34.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:14:34.066+0000 7fa8fc58e640 1 -- 172.21.15.175:0/2839420746 wait complete. 2024-09-11T08:14:34.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:34.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: Reconfiguring mon.b (monmap changed)... 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: Reconfiguring daemon mon.b on smithi175 2024-09-11T08:14:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:34.868 DEBUG:teuthology.orchestra.run.smithi175:mgr.x> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T08:14:34.871 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T08:14:34.871 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:14:34.871 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T08:14:34.889 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T08:14:34.889 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 961 Links: 1 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-11 08:14:22.376505368 +0000 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-11 08:07:47.743778223 +0000 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-11 08:07:47.743778223 +0000 2024-09-11T08:14:34.945 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-11 08:07:47.743778223 +0000 2024-09-11T08:14:34.946 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T08:14:35.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-11T08:14:35.011 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-11T08:14:35.011 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000225759 s, 2.3 MB/s 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: Reconfiguring mon.b (monmap changed)... 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:35.011 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: Reconfiguring daemon mon.b on smithi175 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: Reconfiguring mon.b (monmap changed)... 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: Reconfiguring daemon mon.b on smithi175 2024-09-11T08:14:35.012 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:35.013 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T08:14:35.070 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 976 Links: 1 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-11 08:14:22.376505368 +0000 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-11 08:07:47.745778181 +0000 2024-09-11T08:14:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-11 08:07:47.745778181 +0000 2024-09-11T08:14:35.127 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-11 08:07:47.745778181 +0000 2024-09-11T08:14:35.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T08:14:35.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-11T08:14:35.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-11T08:14:35.190 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000219304 s, 2.3 MB/s 2024-09-11T08:14:35.191 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T08:14:35.248 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-11T08:14:35.303 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 982 Links: 1 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-11 08:14:22.376505368 +0000 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-11 08:07:47.747778138 +0000 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-11 08:07:47.747778138 +0000 2024-09-11T08:14:35.304 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-11 08:07:47.747778138 +0000 2024-09-11T08:14:35.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T08:14:35.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-11T08:14:35.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-11T08:14:35.366 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000180228 s, 2.8 MB/s 2024-09-11T08:14:35.367 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T08:14:35.423 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-11T08:14:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T08:14:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:35.478 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 971 Links: 1 2024-09-11T08:14:35.478 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:35.479 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:35.479 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-11 08:14:22.377505347 +0000 2024-09-11T08:14:35.479 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-11 08:07:47.744778202 +0000 2024-09-11T08:14:35.479 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-11 08:07:47.744778202 +0000 2024-09-11T08:14:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-11 08:07:47.744778202 +0000 2024-09-11T08:14:35.479 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T08:14:35.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-11T08:14:35.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-11T08:14:35.542 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000206823 s, 2.5 MB/s 2024-09-11T08:14:35.543 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T08:14:35.600 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:14:35.600 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T08:14:35.617 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T08:14:35.617 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-11T08:14:35.673 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 969 Links: 1 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 08:14:13.578206344 +0000 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:35.674 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:35.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T08:14:35.737 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T08:14:35.737 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T08:14:35.737 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000190878 s, 2.7 MB/s 2024-09-11T08:14:35.738 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T08:14:35.795 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-11T08:14:35.850 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T08:14:35.850 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:35.850 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 979 Links: 1 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 08:14:13.578206344 +0000 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 08:07:47.796530526 +0000 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 08:07:47.796530526 +0000 2024-09-11T08:14:35.851 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 08:07:47.796530526 +0000 2024-09-11T08:14:35.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T08:14:35.915 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T08:14:35.915 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T08:14:35.915 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000226208 s, 2.3 MB/s 2024-09-11T08:14:35.917 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T08:14:35.973 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-11T08:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 982 Links: 1 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 08:14:13.578206344 +0000 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 08:07:47.801530445 +0000 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 08:07:47.801530445 +0000 2024-09-11T08:14:36.029 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 08:07:47.801530445 +0000 2024-09-11T08:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi173=y;smithi175=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: Saving service mgr spec with placement smithi173=y;smithi175=x;count:2 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.090 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:36.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:36.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T08:14:36.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:36.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T08:14:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T08:14:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000211637 s, 2.4 MB/s 2024-09-11T08:14:36.093 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T08:14:36.149 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-11T08:14:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T08:14:36.204 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 967 Links: 1 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 08:14:13.579206327 +0000 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:36.205 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 08:07:47.795530543 +0000 2024-09-11T08:14:36.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T08:14:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi173=y;smithi175=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: Saving service mgr spec with placement smithi173=y;smithi175=x;count:2 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T08:14:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi173=y;smithi175=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: Saving service mgr spec with placement smithi173=y;smithi175=x;count:2 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T08:14:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:36.272 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T08:14:36.272 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T08:14:36.272 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000179662 s, 2.8 MB/s 2024-09-11T08:14:36.273 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T08:14:36.329 INFO:tasks.cephadm:Deploying osd.0 on smithi173 with /dev/vg_nvme/lv_4... 2024-09-11T08:14:36.330 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-11T08:14:36.564 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:36.934 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:36 smithi173 ceph-mon[29664]: Deploying daemon mgr.x on smithi175 2024-09-11T08:14:36.934 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:36 smithi173 ceph-mon[40835]: Deploying daemon mgr.x on smithi175 2024-09-11T08:14:37.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:36 smithi175 ceph-mon[32813]: Deploying daemon mgr.x on smithi175 2024-09-11T08:14:37.730 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 systemd[1]: Starting Ceph mgr.x for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:14:37.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:37 smithi173 ceph-mon[40835]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:37 smithi173 ceph-mon[29664]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:37.999 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:37 smithi175 ceph-mon[32813]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:38.000 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 podman[34858]: 2024-09-11 08:14:37.632507584 +0000 UTC m=+0.015365904 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:14:38.000 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 podman[34858]: 2024-09-11 08:14:37.754725261 +0000 UTC m=+0.137583613 container create 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:14:38.000 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 podman[34858]: 2024-09-11 08:14:37.973731871 +0000 UTC m=+0.356590181 container init 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T08:14:38.000 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 podman[34858]: 2024-09-11 08:14:37.978330065 +0000 UTC m=+0.361188375 container start 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T08:14:38.000 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:37 smithi175 ceph-mgr[34895]: -- 172.21.15.175:0/478900202 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec8e1f4340 con 0x55ec8e200c00 2024-09-11T08:14:38.107 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-11T08:14:38.188 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-11T08:14:38.201 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-09-11T08:14:38.201 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-09-11T08:14:38.202 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114414 s, 916 MB/s 2024-09-11T08:14:38.202 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-09-11T08:14:38.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 bash[34858]: 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea 2024-09-11T08:14:38.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 systemd[1]: Started Ceph mgr.x for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:14:38.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.095+0000 7f0c04185ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:14:38.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.157+0000 7f0c04185ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:14:38.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.224+0000 7f0c04185ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:14:38.780 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.355+0000 7f0c04185ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:14:38.780 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.501+0000 7f0c04185ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:14:38.780 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.779+0000 7f0c04185ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:14:38.811 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-09-11T08:14:39.058 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:39.094 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:38.843+0000 7f0c04185ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:14:39.094 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:39.013+0000 7f0c04185ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:14:39.423 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[29664]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:39.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:39 smithi173 ceph-mon[40835]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-mon[32813]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:40.301 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:39.863+0000 7f0c04185ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:14:40.301 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:39.925+0000 7f0c04185ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: Reconfiguring mgr.y (unknown last config time)... 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:40.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: Reconfiguring daemon mgr.y on smithi173 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: Reconfiguring mgr.y (unknown last config time)... 2024-09-11T08:14:40.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:40.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:40.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: Reconfiguring daemon mgr.y on smithi173 2024-09-11T08:14:40.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: Reconfiguring mgr.y (unknown last config time)... 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: Reconfiguring daemon mgr.y on smithi173 2024-09-11T08:14:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:40.916 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:40.625+0000 7f0c04185ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:14:40.917 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:40.734+0000 7f0c04185ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:14:40.917 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:40.853+0000 7f0c04185ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:14:41.292 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:40.915+0000 7f0c04185ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:14:41.292 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.039+0000 7f0c04185ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:14:41.292 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.104+0000 7f0c04185ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:14:41.292 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.160+0000 7f0c04185ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:14:41.292 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.291+0000 7f0c04185ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:14:41.434 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:41.434 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.434 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.434 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:41.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:41.554 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:41.555 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.354+0000 7f0c04185ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:14:41.555 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.418+0000 7f0c04185ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:14:41.555 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.496+0000 7f0c04185ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:14:41.555 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.553+0000 7f0c04185ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 -- 172.21.15.173:0/4139257204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fb760 msgr2=0x7f5c180fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 --2- 172.21.15.173:0/4139257204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fb760 0x7f5c180fbb70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c08004950 tx=0x7f5c08009da0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 -- 172.21.15.173:0/4139257204 shutdown_connections 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 --2- 172.21.15.173:0/4139257204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fd3e0 0x7f5c18103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 --2- 172.21.15.173:0/4139257204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fca30 0x7f5c180fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.615+0000 7f5c1d726640 1 --2- 172.21.15.173:0/4139257204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fb760 0x7f5c180fbb70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- 172.21.15.173:0/4139257204 >> 172.21.15.173:0/4139257204 conn(0x7f5c180f6f20 msgr2=0x7f5c180f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- 172.21.15.173:0/4139257204 shutdown_connections 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- 172.21.15.173:0/4139257204 wait complete. 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 Processor -- start 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- start start 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fca30 0x7f5c1810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 0x7f5c181140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181146a0 con 0x7f5c180fd3e0 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18114810 con 0x7f5c180fca30 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.616+0000 7f5c1d726640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181149d0 con 0x7f5c180fb760 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c16ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c16ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:50102/0 (socket says 172.21.15.173:50102) 2024-09-11T08:14:41.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c16ffd640 1 -- 172.21.15.173:0/2072050792 learned_addr learned my addr 172.21.15.173:0/2072050792 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 0x7f5c181140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c0e7fc640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fca30 0x7f5c1810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 -- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 msgr2=0x7f5c1810cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 -- 172.21.15.173:0/2072050792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fca30 msgr2=0x7f5c1810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fca30 0x7f5c1810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 -- 172.21.15.173:0/2072050792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08005040 con 0x7f5c180fd3e0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c16ffd640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c177fe640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 0x7f5c181140d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000db80 tx=0x7f5c10004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10017070 con 0x7f5c180fd3e0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f5c1000f040 con 0x7f5c180fd3e0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100036a0 con 0x7f5c180fd3e0 2024-09-11T08:14:41.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18114cb0 con 0x7f5c180fd3e0 2024-09-11T08:14:41.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.617+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c18115130 con 0x7f5c180fd3e0 2024-09-11T08:14:41.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.618+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f5c10003ad0 con 0x7f5c180fd3e0 2024-09-11T08:14:41.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.618+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1804bf60 con 0x7f5c180fd3e0 2024-09-11T08:14:41.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.618+0000 7f5c0ffff640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 0x7f5c0403bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:14:41.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.618+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5c1004bfb0 con 0x7f5c180fd3e0 2024-09-11T08:14:41.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.618+0000 7f5c16ffd640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 0x7f5c0403bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:14:41.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.619+0000 7f5c16ffd640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 0x7f5c0403bc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009040 tx=0x7f5c08035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:14:41.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.623+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c10011520 con 0x7f5c180fd3e0 2024-09-11T08:14:41.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:41.786+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c1805db50 con 0x7f5c040397c0 2024-09-11T08:14:41.844 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:41.609+0000 7f0c04185ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:14:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[29664]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[40835]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:14:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:42 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:42.594 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:14:42 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:14:42.343+0000 7f0c04185ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:14:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:42 smithi175 ceph-mon[32813]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:14:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:42 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:14:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:42 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:14:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:42 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:43.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:43.323+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 14) v1 ==== 90725+0+0 (secure 0 0 0) 0x7f5c10013490 con 0x7f5c180fd3e0 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: Standby manager daemon x started 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:43.410 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: Standby manager daemon x started 2024-09-11T08:14:43.411 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:14:43.411 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:14:43.411 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:14:43.411 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:43 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:14:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: Standby manager daemon x started 2024-09-11T08:14:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:14:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:14:43.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:14:43.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:43 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/1355123605' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:14:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: mgrmap e14: y(active, since 63s), standbys: x 2024-09-11T08:14:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:14:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]: dispatch 2024-09-11T08:14:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]': finished 2024-09-11T08:14:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T08:14:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: mgrmap e14: y(active, since 63s), standbys: x 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]: dispatch 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]': finished 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:14:44.596 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: mgrmap e14: y(active, since 63s), standbys: x 2024-09-11T08:14:44.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:14:44.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]: dispatch 2024-09-11T08:14:44.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4142551141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ab3b916-d9b5-4d36-b89e-555941b2ef9d"}]': finished 2024-09-11T08:14:44.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T08:14:44.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:14:45.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:45 smithi175 ceph-mon[32813]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:45.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3486611262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:14:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:45 smithi173 ceph-mon[40835]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3486611262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:14:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:45 smithi173 ceph-mon[29664]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3486611262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:14:47.376 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:47 smithi173 ceph-mon[29664]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:47.376 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:47 smithi173 ceph-mon[40835]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:47.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:47 smithi175 ceph-mon[32813]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:49.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:49 smithi173 ceph-mon[29664]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:49 smithi173 ceph-mon[40835]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:49 smithi175 ceph-mon[32813]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:50.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T08:14:50.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:50.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T08:14:50.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T08:14:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:51.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:51 smithi173 ceph-mon[29664]: Deploying daemon osd.0 on smithi173 2024-09-11T08:14:51.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:51 smithi173 ceph-mon[29664]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:51.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:51 smithi173 ceph-mon[40835]: Deploying daemon osd.0 on smithi173 2024-09-11T08:14:51.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:51 smithi173 ceph-mon[40835]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:51 smithi175 ceph-mon[32813]: Deploying daemon osd.0 on smithi173 2024-09-11T08:14:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:51 smithi175 ceph-mon[32813]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:53.567 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:53 smithi173 ceph-mon[29664]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:53.567 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:53 smithi173 ceph-mon[40835]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:53 smithi175 ceph-mon[32813]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[29664]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[40835]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:55.398 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:55 smithi175 ceph-mon[32813]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[29664]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:57.667 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.668 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.668 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[40835]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:57.668 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.668 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:57 smithi175 ceph-mon[32813]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:57.972 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 0 on host 'smithi173' 2024-09-11T08:14:57.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.971+0000 7f5c0ffff640 1 -- 172.21.15.173:0/2072050792 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5c1805db50 con 0x7f5c040397c0 2024-09-11T08:14:57.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 msgr2=0x7f5c0403bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 0x7f5c0403bc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009040 tx=0x7f5c08035040 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 msgr2=0x7f5c181140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 0x7f5c181140d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000db80 tx=0x7f5c10004db0 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 shutdown_connections 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c180fd3e0 0x7f5c181140d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c180fca30 0x7f5c1810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5c040397c0 0x7f5c0403bc70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 --2- 172.21.15.173:0/2072050792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c180fb760 0x7f5c1810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 >> 172.21.15.173:0/2072050792 conn(0x7f5c180f6f20 msgr2=0x7f5c180fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 shutdown_connections 2024-09-11T08:14:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:14:57.974+0000 7f5c1d726640 1 -- 172.21.15.173:0/2072050792 wait complete. 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:58.589 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.612 DEBUG:teuthology.orchestra.run.smithi173:osd.0> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T08:14:58.614 INFO:tasks.cephadm:Deploying osd.1 on smithi173 with /dev/vg_nvme/lv_3... 2024-09-11T08:14:58.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-11T08:14:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:14:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:14:58.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T08:14:58.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:14:58.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:58.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:14:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:14:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[40835]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[40835]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[40835]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[40835]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[29664]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[29664]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[29664]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:14:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-mon[29664]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:14:59.968 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:14:59.695+0000 7fbde10de640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T08:14:59.968 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:14:59 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:14:59.697+0000 7fbddc716640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:15:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:59 smithi175 ceph-mon[32813]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:15:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:59 smithi175 ceph-mon[32813]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T08:15:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:59 smithi175 ceph-mon[32813]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T08:15:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:59 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:14:59 smithi175 ceph-mon[32813]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[29664]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[29664]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T08:15:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[40835]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[40835]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T08:15:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:00 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:00 smithi175 ceph-mon[32813]: from='osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:00 smithi175 ceph-mon[32813]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T08:15:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:00 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:00 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] boot 2024-09-11T08:15:01.896 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] boot 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T08:15:01.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:01 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-11T08:15:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: osd.0 [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] boot 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T08:15:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:01 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:15:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-11T08:15:02.122 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-09-11T08:15:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-09-11T08:15:02.122 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124117 s, 845 MB/s 2024-09-11T08:15:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:02.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-09-11T08:15:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T08:15:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:15:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[29664]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi173 2024-09-11T08:15:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 16064M 2024-09-11T08:15:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[40835]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi173 2024-09-11T08:15:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:03 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 16064M 2024-09-11T08:15:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:03 smithi175 ceph-mon[32813]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:04.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:03 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi173 2024-09-11T08:15:04.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:03 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 16064M 2024-09-11T08:15:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.902+0000 7fd6acd8b640 1 -- 172.21.15.173:0/29734486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 msgr2=0x7fd6a80fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.902+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/29734486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a80fbb70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd698004890 tx=0x7fd698009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- 172.21.15.173:0/29734486 shutdown_connections 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/29734486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a80fd3e0 0x7fd6a8103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/29734486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 0x7fd6a80fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/29734486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a80fbb70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- 172.21.15.173:0/29734486 >> 172.21.15.173:0/29734486 conn(0x7fd6a80f6f20 msgr2=0x7fd6a80f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- 172.21.15.173:0/29734486 shutdown_connections 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- 172.21.15.173:0/29734486 wait complete. 2024-09-11T08:15:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 Processor -- start 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- start start 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 0x7fd6a810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a80fd3e0 0x7fd6a8114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8114720 con 0x7fd6a80fb760 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8114890 con 0x7fd6a80fd3e0 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6acd8b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8114a50 con 0x7fd6a80fca30 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6a659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6a659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44800/0 (socket says 172.21.15.173:44800) 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6a659c640 1 -- 172.21.15.173:0/158668564 learned_addr learned my addr 172.21.15.173:0/158668564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.903+0000 7fd6a5d9b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 0x7fd6a810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 -- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 msgr2=0x7fd6a810d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 0x7fd6a810d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 -- 172.21.15.173:0/158668564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a80fd3e0 msgr2=0x7fd6a8114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a80fd3e0 0x7fd6a8114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 -- 172.21.15.173:0/158668564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c005040 con 0x7fd6a80fb760 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6a659c640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6980048f0 tx=0x7fd698009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698009860 con 0x7fd6a80fb760 2024-09-11T08:15:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fd69803c8c0 con 0x7fd6a80fb760 2024-09-11T08:15:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd698005040 con 0x7fd6a80fb760 2024-09-11T08:15:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980336b0 con 0x7fd6a80fb760 2024-09-11T08:15:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.904+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a8115010 con 0x7fd6a80fb760 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.905+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8106b50 con 0x7fd6a80fb760 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.906+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 14) v1 ==== 90725+0+0 (secure 0 0 0) 0x7fd698030020 con 0x7fd6a80fb760 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.906+0000 7fd696ffd640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 0x7fd690071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.906+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1763+0+0 (secure 0 0 0) 0x7fd6980ace80 con 0x7fd6a80fb760 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.906+0000 7fd6a5d9b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 0x7fd690071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.907+0000 7fd6a5d9b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 0x7fd690071270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd6a810e0b0 tx=0x7fd69c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:04.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:04.910+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6980771b0 con 0x7fd6a80fb760 2024-09-11T08:15:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:05.072+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6a8066690 con 0x7fd69006edc0 2024-09-11T08:15:05.800 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[29664]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:05.800 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[40835]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:05.801 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:05 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:05 smithi175 ceph-mon[32813]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:05 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:05 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:05 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:06.883 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:06 smithi173 ceph-mon[29664]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:06.883 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:06 smithi173 ceph-mon[40835]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:06 smithi175 ceph-mon[32813]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3364336445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]': finished 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:07.870 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:07.871 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3364336445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:07.871 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:07.871 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]': finished 2024-09-11T08:15:07.871 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T08:15:07.871 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:07 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3364336445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]: dispatch 2024-09-11T08:15:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8052c26f-b90b-4c4a-a1ef-02090406b450"}]': finished 2024-09-11T08:15:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T08:15:08.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:07 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2215248113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2215248113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:09.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2215248113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:10.013 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:09 smithi173 ceph-mon[29664]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:10.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:09 smithi173 ceph-mon[40835]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:09 smithi175 ceph-mon[32813]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:12.088 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:11 smithi173 ceph-mon[29664]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:12.088 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:11 smithi173 ceph-mon[40835]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:11 smithi175 ceph-mon[32813]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:14.057 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[29664]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:14.058 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T08:15:14.058 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:14.058 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[40835]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:14.058 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T08:15:14.058 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:13 smithi175 ceph-mon[32813]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T08:15:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:14 smithi173 ceph-mon[29664]: Deploying daemon osd.1 on smithi173 2024-09-11T08:15:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:14 smithi173 ceph-mon[40835]: Deploying daemon osd.1 on smithi173 2024-09-11T08:15:15.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:14 smithi175 ceph-mon[32813]: Deploying daemon osd.1 on smithi173 2024-09-11T08:15:15.835 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:15 smithi173 ceph-mon[29664]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:15.835 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:15 smithi173 ceph-mon[40835]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:15 smithi175 ceph-mon[32813]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:17.916 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:17 smithi173 ceph-mon[29664]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:17.917 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:17 smithi173 ceph-mon[40835]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:17 smithi175 ceph-mon[32813]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:18.825 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:18.826 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:18.826 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:18.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:18.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:18.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:19.890 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:19 smithi173 ceph-mon[29664]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:19.890 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:19 smithi173 ceph-mon[40835]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:19.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:19 smithi175 ceph-mon[32813]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:21.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.216+0000 7fd696ffd640 1 -- 172.21.15.173:0/158668564 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd6a8066690 con 0x7fd69006edc0 2024-09-11T08:15:21.217 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 1 on host 'smithi173' 2024-09-11T08:15:21.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 msgr2=0x7fd690071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:21.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 0x7fd690071270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd6a810e0b0 tx=0x7fd69c00b040 comp rx=0 tx=0).stop 2024-09-11T08:15:21.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 msgr2=0x7fd6a810cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:21.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6980048f0 tx=0x7fd698009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:21.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 shutdown_connections 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a80fd3e0 0x7fd6a8114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fd69006edc0 0x7fd690071270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6a80fca30 0x7fd6a810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 --2- 172.21.15.173:0/158668564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a80fb760 0x7fd6a810cbb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 >> 172.21.15.173:0/158668564 conn(0x7fd6a80f6f20 msgr2=0x7fd6a8065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 shutdown_connections 2024-09-11T08:15:21.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:21.218+0000 7fd6acd8b640 1 -- 172.21.15.173:0/158668564 wait complete. 2024-09-11T08:15:21.853 DEBUG:teuthology.orchestra.run.smithi173:osd.1> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T08:15:21.856 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_2... 2024-09-11T08:15:21.856 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-11T08:15:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:21 smithi175 ceph-mon[32813]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:21 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:21 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:21 smithi175 ceph-mon[32813]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T08:15:22.169 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[40835]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[40835]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[29664]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:21 smithi173 ceph-mon[29664]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T08:15:23.304 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.304 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.304 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[29664]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T08:15:23.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:23.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:23.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-mon[40835]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:23.306 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1[51250]: 2024-09-11T08:15:23.227+0000 7fe7083c6640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T08:15:23.306 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:23 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1[51250]: 2024-09-11T08:15:23.231+0000 7fe6ff9d4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:15:23.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:23.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T08:15:23.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T08:15:23.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:23.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:23.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:23 smithi175 ceph-mon[32813]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:23.788 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-11T08:15:23.880 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-11T08:15:23.894 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-09-11T08:15:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-09-11T08:15:23.895 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132657 s, 790 MB/s 2024-09-11T08:15:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[29664]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[29664]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[40835]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[40835]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:24 smithi175 ceph-mon[32813]: from='osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:24 smithi175 ceph-mon[32813]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T08:15:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:24.871 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] boot 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T08:15:25.517 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[29664]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] boot 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:25 smithi173 ceph-mon[40835]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:25.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: osd.1 [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] boot 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:15:25.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:25 smithi175 ceph-mon[32813]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-11T08:15:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:15:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:26 smithi173 ceph-mon[29664]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T08:15:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:26 smithi173 ceph-mon[40835]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T08:15:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:26 smithi175 ceph-mon[32813]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.449 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:27.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:27.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:27.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 -- 172.21.15.173:0/68390614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fca00 msgr2=0x7f8be00fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 --2- 172.21.15.173:0/68390614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fca00 0x7f8be00fce70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004890 tx=0x7f8bd4009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 -- 172.21.15.173:0/68390614 shutdown_connections 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 --2- 172.21.15.173:0/68390614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fd3b0 0x7f8be0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 --2- 172.21.15.173:0/68390614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fca00 0x7f8be00fce70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 --2- 172.21.15.173:0/68390614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fb730 0x7f8be00fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 -- 172.21.15.173:0/68390614 >> 172.21.15.173:0/68390614 conn(0x7f8be00f6ef0 msgr2=0x7f8be00f9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 -- 172.21.15.173:0/68390614 shutdown_connections 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.914+0000 7f8be5b53640 1 -- 172.21.15.173:0/68390614 wait complete. 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 Processor -- start 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 -- start start 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 0x7f8be0113cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:27.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fd3b0 0x7f8be0116240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0116810 con 0x7f8be00fb730 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0116980 con 0x7f8be00fca00 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8be5b53640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0116b40 con 0x7f8be00fd3b0 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48240/0 (socket says 172.21.15.173:48240) 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8bdf7fe640 1 -- 172.21.15.173:0/795713405 learned_addr learned my addr 172.21.15.173:0/795713405 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.915+0000 7f8bdffff640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fd3b0 0x7f8be0116240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdeffd640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 0x7f8be0113cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 -- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fd3b0 msgr2=0x7f8be0116240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fd3b0 0x7f8be0116240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 -- 172.21.15.173:0/795713405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 msgr2=0x7f8be0113cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 0x7f8be0113cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 -- 172.21.15.173:0/795713405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0005040 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdeffd640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 0x7f8be0113cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bdf7fe640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009550 tx=0x7f8bd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000e930 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f8bd000f040 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4005040 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0013b10 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.916+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be0117160 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.917+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be004bf60 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.918+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 14) v1 ==== 90725+0+0 (secure 0 0 0) 0x7f8bd000ea90 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.918+0000 7f8bc7fff640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 0x7f8bc8071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.918+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2195+0+0 (secure 0 0 0) 0x7f8bd008d160 con 0x7f8be00fb730 2024-09-11T08:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.918+0000 7f8bdeffd640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 0x7f8bc8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:27.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.919+0000 7f8bdeffd640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 0x7f8bc8071240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004480 tx=0x7f8bd4009da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:27.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:27.922+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8bd00571b0 con 0x7f8be00fb730 2024-09-11T08:15:28.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:28.085+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8be005db50 con 0x7f8bc806ed90 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi173 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 8032M 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi173 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 8032M 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:28 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi173 2024-09-11T08:15:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:28 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 8032M 2024-09-11T08:15:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:28.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:29 smithi173 ceph-mon[29664]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:29 smithi173 ceph-mon[29664]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:29.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:29 smithi173 ceph-mon[40835]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:29.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:29 smithi173 ceph-mon[40835]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:29 smithi175 ceph-mon[32813]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:29 smithi175 ceph-mon[32813]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]: dispatch 2024-09-11T08:15:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]': finished 2024-09-11T08:15:31.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T08:15:31.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:31.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3737769107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]: dispatch 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]': finished 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3737769107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]: dispatch 2024-09-11T08:15:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2300112839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2086bc5-1352-4a1a-84fd-46bfb860441a"}]': finished 2024-09-11T08:15:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T08:15:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3737769107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:33.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:33 smithi173 ceph-mon[29664]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:33 smithi173 ceph-mon[40835]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:33 smithi175 ceph-mon[32813]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:35.546 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:35 smithi173 ceph-mon[29664]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:35.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:35 smithi173 ceph-mon[40835]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:35.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:35 smithi175 ceph-mon[32813]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[29664]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[29664]: Deploying daemon osd.2 on smithi173 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[40835]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:37 smithi173 ceph-mon[40835]: Deploying daemon osd.2 on smithi173 2024-09-11T08:15:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:37 smithi175 ceph-mon[32813]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:37 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T08:15:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:37 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:37 smithi175 ceph-mon[32813]: Deploying daemon osd.2 on smithi173 2024-09-11T08:15:39.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:39 smithi173 ceph-mon[40835]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:39.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:39 smithi173 ceph-mon[29664]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:39 smithi175 ceph-mon[32813]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[29664]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[40835]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:41.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:41 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:41 smithi175 ceph-mon[32813]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:41 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:43.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:43 smithi173 ceph-mon[29664]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:43.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:43 smithi173 ceph-mon[40835]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:43 smithi175 ceph-mon[32813]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.586+0000 7f8bc7fff640 1 -- 172.21.15.173:0/795713405 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8be005db50 con 0x7f8bc806ed90 2024-09-11T08:15:44.587 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 msgr2=0x7f8bc8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 0x7f8bc8071240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004480 tx=0x7f8bd4009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 msgr2=0x7f8be0066a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009550 tx=0x7f8bd0009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 shutdown_connections 2024-09-11T08:15:44.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc806ed90 0x7f8bc8071240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8be00fd3b0 0x7f8be0116240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be00fca00 0x7f8be0113cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 --2- 172.21.15.173:0/795713405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be00fb730 0x7f8be0066a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 >> 172.21.15.173:0/795713405 conn(0x7f8be00f6ef0 msgr2=0x7f8be00fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 shutdown_connections 2024-09-11T08:15:44.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:44.588+0000 7f8be5b53640 1 -- 172.21.15.173:0/795713405 wait complete. 2024-09-11T08:15:45.166 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.167 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.168 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.190 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T08:15:45.193 INFO:tasks.cephadm:Deploying osd.3 on smithi173 with /dev/vg_nvme/lv_1... 2024-09-11T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-11T08:15:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:15:46.049 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[29664]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T08:15:46.049 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[29664]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T08:15:46.049 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:46.049 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[29664]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:46.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[40835]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T08:15:46.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[40835]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T08:15:46.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:46.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-mon[40835]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:46.050 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2[57659]: 2024-09-11T08:15:45.944+0000 7fd8485bd640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T08:15:46.050 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:45 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2[57659]: 2024-09-11T08:15:45.949+0000 7fd8453f8640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:15:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:45 smithi175 ceph-mon[32813]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T08:15:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:45 smithi175 ceph-mon[32813]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T08:15:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:45 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:45 smithi175 ceph-mon[32813]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[29664]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[29664]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[29664]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[40835]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[40835]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T08:15:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:46 smithi173 ceph-mon[40835]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:46 smithi175 ceph-mon[32813]: from='osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:15:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:46 smithi175 ceph-mon[32813]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T08:15:47.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:46 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:46 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:47.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:46 smithi175 ceph-mon[32813]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] boot 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:15:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:15:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] boot 2024-09-11T08:15:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T08:15:48.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:48.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:15:48.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:15:48.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:48.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: osd.2 [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] boot 2024-09-11T08:15:48.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T08:15:48.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:15:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T08:15:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-11T08:15:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T08:15:49.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:49.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-11T08:15:49.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:49.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:48 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-11T08:15:49.245 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T08:15:49.245 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:49.245 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:15:49.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:48 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:49.333 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-11T08:15:49.346 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-09-11T08:15:49.346 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-09-11T08:15:49.346 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113682 s, 922 MB/s 2024-09-11T08:15:49.346 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-09-11T08:15:49.939 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-09-11T08:15:50.192 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi173 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 5354M 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[29664]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi173 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 5354M 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-11T08:15:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[40835]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T08:15:50.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:49 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:15:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:49 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi173 2024-09-11T08:15:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:49 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 5354M 2024-09-11T08:15:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:49 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-11T08:15:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:49 smithi175 ceph-mon[32813]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T08:15:50.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:49 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:15:50.576 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61939]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:50.576 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:50.576 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:50.576 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61939]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:50.962 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:50.962 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:50.962 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:50.962 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61978]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[29664]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[29664]: pgmap v76: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[40835]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[40835]: pgmap v76: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:51.218 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61987]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:51.218 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61987]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:51.218 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:51.218 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:50 smithi173 sudo[61987]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:15:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:50 smithi175 ceph-mon[32813]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T08:15:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:50 smithi175 ceph-mon[32813]: pgmap v76: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:51.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:51.475 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[61991]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:51.475 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[61991]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:51.475 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[61991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:51.475 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[61991]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:51.736 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62014]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:51.736 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62014]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:51.736 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:51.736 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62014]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 -- 172.21.15.173:0/632845902 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fca30 msgr2=0x7fa0c40fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 --2- 172.21.15.173:0/632845902 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fca30 0x7fa0c40fcea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac004950 tx=0x7fa0ac009da0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 -- 172.21.15.173:0/632845902 shutdown_connections 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 --2- 172.21.15.173:0/632845902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 --2- 172.21.15.173:0/632845902 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fca30 0x7fa0c40fcea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 --2- 172.21.15.173:0/632845902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fb760 0x7fa0c40fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 -- 172.21.15.173:0/632845902 >> 172.21.15.173:0/632845902 conn(0x7fa0c40f6f20 msgr2=0x7fa0c40f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 -- 172.21.15.173:0/632845902 shutdown_connections 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.939+0000 7fa0ca788640 1 -- 172.21.15.173:0/632845902 wait complete. 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 Processor -- start 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 -- start start 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fb760 0x7fa0c4065c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41146b0 con 0x7fa0c40fd3e0 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4114820 con 0x7fa0c40fca30 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0ca788640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41149e0 con 0x7fa0c40fb760 2024-09-11T08:15:51.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fb760 0x7fa0c4065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c8d25640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c8d25640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57144/0 (socket says 172.21.15.173:57144) 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.173:48750/0 (socket says 172.21.15.173:48750) 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.940+0000 7fa0c8d25640 1 -- 172.21.15.173:0/363581396 learned_addr learned my addr 172.21.15.173:0/363581396 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 -- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fb760 msgr2=0x7fa0c4065c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fb760 0x7fa0c4065c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 -- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 msgr2=0x7fa0c4113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 -- 172.21.15.173:0/363581396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac005040 con 0x7fa0c40fca30 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c37fe640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009f80 tx=0x7fa0ac035040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac033420 con 0x7fa0c40fca30 2024-09-11T08:15:51.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fa0ac0339c0 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c4114c60 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac032700 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.941+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c4115150 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.942+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c4106b90 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.943+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7fa0ac030020 con 0x7fa0c40fca30 2024-09-11T08:15:51.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.943+0000 7fa0c0ff9640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 0x7fa0b00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:15:51.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.943+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3013+0+0 (secure 0 0 0) 0x7fa0ac0ad1a0 con 0x7fa0c40fca30 2024-09-11T08:15:51.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.943+0000 7fa0c3fff640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 0x7fa0b00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:15:51.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.944+0000 7fa0c3fff640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 0x7fa0b00712d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4004ed0 tx=0x7fa0b400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:15:51.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:51.948+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa0ac076f70 con 0x7fa0c40fca30 2024-09-11T08:15:51.999 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:51.999 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:51.999 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:51.999 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62037]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:52.000 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:52.000 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:52.000 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:52.000 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:51 smithi173 sudo[62066]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:52.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:15:52.117+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0c4106510 con 0x7fa0b006ee20 2024-09-11T08:15:52.249 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[40835]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-11T08:15:52.249 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[40835]: osdmap e22: 3 total, 3 up, 3 in 2024-09-11T08:15:52.249 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 sudo[62070]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 sudo[62070]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 sudo[62070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 sudo[62070]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[29664]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[29664]: osdmap e22: 3 total, 3 up, 3 in 2024-09-11T08:15:52.250 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:52 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:52.504 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 ceph-mon[32813]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-11T08:15:52.504 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 ceph-mon[32813]: osdmap e22: 3 total, 3 up, 3 in 2024-09-11T08:15:52.504 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:52.504 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:52.505 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:52.505 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:52.505 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35546]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:52 smithi175 sudo[35549]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:53.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62231]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T08:15:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62231]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:53.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:53.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.592 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: pgmap v78: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62242]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62242]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 sudo[62242]: pam_unix(sudo:session): session closed for user root 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: pgmap v78: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: pgmap v78: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:15:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:15:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:54 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:54 smithi175 ceph-mon[32813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:54 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:54 smithi173 ceph-mon[29664]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:54 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T08:15:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:54 smithi173 ceph-mon[40835]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T08:15:55.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: pgmap v79: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:55.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/491531597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]': finished 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/723169357' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: pgmap v79: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/491531597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]': finished 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:15:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/723169357' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: pgmap v79: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/491531597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]: dispatch 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e67f5c-571e-4e76-b3c3-e47e87fd436a"}]': finished 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:15:55.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/723169357' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:15:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:57 smithi175 ceph-mon[32813]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T08:15:57.694 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:57 smithi173 ceph-mon[29664]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T08:15:57.695 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:57 smithi173 ceph-mon[40835]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T08:15:59.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:15:59 smithi173 ceph-mon[29664]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-09-11T08:15:59.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:15:59 smithi173 ceph-mon[40835]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-09-11T08:15:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:15:59 smithi175 ceph-mon[32813]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-09-11T08:16:01.385 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[29664]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[29664]: Deploying daemon osd.3 on smithi173 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[40835]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:01.386 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:01 smithi173 ceph-mon[40835]: Deploying daemon osd.3 on smithi173 2024-09-11T08:16:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:01 smithi175 ceph-mon[32813]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 141 KiB/s wr, 9 op/s 2024-09-11T08:16:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:01 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T08:16:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:01 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:01 smithi175 ceph-mon[32813]: Deploying daemon osd.3 on smithi173 2024-09-11T08:16:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:03 smithi175 ceph-mon[32813]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:03.598 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:03 smithi173 ceph-mon[29664]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:03.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:03 smithi173 ceph-mon[40835]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:05 smithi173 ceph-mon[29664]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:05.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:05 smithi173 ceph-mon[40835]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:05.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:05 smithi175 ceph-mon[32813]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T08:16:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:07.826 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:07 smithi173 ceph-mon[29664]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-09-11T08:16:07.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:07 smithi173 ceph-mon[40835]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-09-11T08:16:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:07 smithi175 ceph-mon[32813]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-09-11T08:16:08.802 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 3 on host 'smithi173' 2024-09-11T08:16:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.800+0000 7fa0c0ff9640 1 -- 172.21.15.173:0/363581396 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa0c4106510 con 0x7fa0b006ee20 2024-09-11T08:16:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 msgr2=0x7fa0b00712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 0x7fa0b00712d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4004ed0 tx=0x7fa0b400b040 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 msgr2=0x7fa0c4111990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009f80 tx=0x7fa0ac035040 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 shutdown_connections 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0c40fd3e0 0x7fa0c4113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40fca30 0x7fa0c4111990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fa0b006ee20 0x7fa0b00712d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 --2- 172.21.15.173:0/363581396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0c40fb760 0x7fa0c4065c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 >> 172.21.15.173:0/363581396 conn(0x7fa0c40f6f20 msgr2=0x7fa0c40ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 shutdown_connections 2024-09-11T08:16:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:16:08.803+0000 7fa0ca788640 1 -- 172.21.15.173:0/363581396 wait complete. 2024-09-11T08:16:09.417 DEBUG:teuthology.orchestra.run.smithi173:osd.3> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T08:16:09.419 INFO:tasks.cephadm:Deploying osd.4 on smithi175 with /dev/vg_nvme/lv_4... 2024-09-11T08:16:09.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-11T08:16:09.668 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[40835]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[40835]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[29664]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[29664]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:09.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:09.788 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:09 smithi175 ceph-mon[32813]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:09.788 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:09 smithi175 ceph-mon[32813]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T08:16:09.789 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:09 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:09.789 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:09 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T08:16:10.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T08:16:10.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:10.932 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:16:10.932 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.932 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T08:16:10.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:10.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-11T08:16:10.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:10.969 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:16:10.650+0000 7f64c8a87640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T08:16:10.969 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:16:10 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:16:10.656+0000 7f64c2099640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:16:11.639 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-11T08:16:11.730 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-11T08:16:11.730 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:11 smithi175 ceph-mon[32813]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:11.730 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:11 smithi175 ceph-mon[32813]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:16:11.731 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:11 smithi175 ceph-mon[32813]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T08:16:11.731 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:11 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:11.731 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:11 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:11.745 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-09-11T08:16:11.745 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-09-11T08:16:11.745 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127557 s, 822 MB/s 2024-09-11T08:16:11.745 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-09-11T08:16:11.903 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[29664]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:11.903 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[29664]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[29664]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[40835]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[40835]: from='osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[40835]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:11.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:11 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-09-11T08:16:12.594 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:12.930 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:16:12.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:16:12.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] boot 2024-09-11T08:16:12.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T08:16:12.931 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:12 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] boot 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:16:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:16:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: osd.3 [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] boot 2024-09-11T08:16:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T08:16:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:12 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:16:13.907 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:13.907 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T08:16:13.907 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.907 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.907 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.908 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:13.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:14.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- 172.21.15.175:0/2023154834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fc1f0 msgr2=0x7efc38103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:14.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- 172.21.15.175:0/2023154834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fc1f0 0x7efc38103cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc30009cd0 tx=0x7efc30004d10 comp rx=0 tx=0).stop 2024-09-11T08:16:14.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- 172.21.15.175:0/2023154834 shutdown_connections 2024-09-11T08:16:14.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- 172.21.15.175:0/2023154834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fc1f0 0x7efc38103cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:14.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- 172.21.15.175:0/2023154834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fd690 0x7efc380fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- 172.21.15.175:0/2023154834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 0x7efc380fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- 172.21.15.175:0/2023154834 >> 172.21.15.175:0/2023154834 conn(0x7efc380f6690 msgr2=0x7efc380f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- 172.21.15.175:0/2023154834 shutdown_connections 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- 172.21.15.175:0/2023154834 wait complete. 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 Processor -- start 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- start start 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fc1f0 0x7efc3810b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 0x7efc3810bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.099+0000 7efc3f049640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc381133d0 con 0x7efc380fcd40 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3f049640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc38113540 con 0x7efc380fd690 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3f049640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc38113700 con 0x7efc380fc1f0 2024-09-11T08:16:14.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38346/0 (socket says 172.21.15.175:38346) 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 -- 172.21.15.175:0/4092613595 learned_addr learned my addr 172.21.15.175:0/4092613595 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3cde5640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fc1f0 0x7efc3810b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc37fff640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 0x7efc3810bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 -- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fc1f0 msgr2=0x7efc3810b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fc1f0 0x7efc3810b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 -- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 msgr2=0x7efc3810bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 0x7efc3810bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 -- 172.21.15.175:0/4092613595 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300098b0 con 0x7efc380fd690 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3d5e6640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc30009ca0 tx=0x7efc30004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30038070 con 0x7efc380fd690 2024-09-11T08:16:14.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7efc30009220 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc38113980 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3003cb30 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.100+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc38113ec0 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.101+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3804bf60 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.102+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7efc30030070 con 0x7efc380fd690 2024-09-11T08:16:14.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.102+0000 7efc357fa640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 0x7efc20071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.102+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3445+0+0 (secure 0 0 0) 0x7efc300adef0 con 0x7efc380fd690 2024-09-11T08:16:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.103+0000 7efc3cde5640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 0x7efc20071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.103+0000 7efc3cde5640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 0x7efc20071300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc38065a30 tx=0x7efc28009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:16:14.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.107+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc30077a90 con 0x7efc380fd690 2024-09-11T08:16:14.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:14.268+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7efc38106570 con 0x7efc2006ee50 2024-09-11T08:16:14.964 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:14 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi173 2024-09-11T08:16:14.964 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:14 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 4016M 2024-09-11T08:16:14.964 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:14 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:14.964 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:14 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:14.965 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:14 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi173 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 4016M 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi173 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 4016M 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:14 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:15.822 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:15 smithi175 ceph-mon[32813]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:15.823 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:15 smithi175 ceph-mon[32813]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:15 smithi173 ceph-mon[29664]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:15.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:15 smithi173 ceph-mon[29664]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:15.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:15 smithi173 ceph-mon[40835]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:15.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:15 smithi173 ceph-mon[40835]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:16.929 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/685182177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.929 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.929 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]': finished 2024-09-11T08:16:16.929 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:16 smithi175 ceph-mon[32813]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T08:16:16.929 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:16 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/685182177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]': finished 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[29664]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/685182177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]: dispatch 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6730fe3b-6d6e-4091-9eed-11e18864e1ab"}]': finished 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[40835]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T08:16:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:16 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:17 smithi173 ceph-mon[29664]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/380180579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:17 smithi173 ceph-mon[40835]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/380180579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:17 smithi175 ceph-mon[32813]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/380180579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:19.934 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:19 smithi175 ceph-mon[32813]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:19 smithi173 ceph-mon[29664]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:19 smithi173 ceph-mon[40835]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:21.888 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:21 smithi175 ceph-mon[32813]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:21 smithi173 ceph-mon[29664]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:21 smithi173 ceph-mon[40835]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:22 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T08:16:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:22 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:22.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:22 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T08:16:22.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:22 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T08:16:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:22 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:23 smithi175 ceph-mon[32813]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:23 smithi175 ceph-mon[32813]: Deploying daemon osd.4 on smithi175 2024-09-11T08:16:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:23 smithi173 ceph-mon[29664]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:23 smithi173 ceph-mon[29664]: Deploying daemon osd.4 on smithi175 2024-09-11T08:16:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:23 smithi173 ceph-mon[40835]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:23 smithi173 ceph-mon[40835]: Deploying daemon osd.4 on smithi175 2024-09-11T08:16:25.953 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:25 smithi175 ceph-mon[32813]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:25 smithi173 ceph-mon[29664]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:25 smithi173 ceph-mon[40835]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[29664]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[40835]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:27 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:27.971 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:27 smithi175 ceph-mon[32813]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:27.971 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:27.971 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:27.971 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:27 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:29.920 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:29 smithi175 ceph-mon[32813]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:29 smithi173 ceph-mon[29664]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:29 smithi173 ceph-mon[40835]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.562+0000 7efc357fa640 1 -- 172.21.15.175:0/4092613595 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efc38106570 con 0x7efc2006ee50 2024-09-11T08:16:30.565 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 4 on host 'smithi175' 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 msgr2=0x7efc20071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 0x7efc20071300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc38065a30 tx=0x7efc28009040 comp rx=0 tx=0).stop 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 msgr2=0x7efc38112e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc30009ca0 tx=0x7efc30004d10 comp rx=0 tx=0).stop 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 shutdown_connections 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc380fd690 0x7efc38112e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc380fcd40 0x7efc3810bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7efc2006ee50 0x7efc20071300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 --2- 172.21.15.175:0/4092613595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc380fc1f0 0x7efc3810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 >> 172.21.15.175:0/4092613595 conn(0x7efc380f6690 msgr2=0x7efc380ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:16:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 shutdown_connections 2024-09-11T08:16:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:30.564+0000 7efc3f049640 1 -- 172.21.15.175:0/4092613595 wait complete. 2024-09-11T08:16:31.129 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.129 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.129 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.130 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:30 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.158 DEBUG:teuthology.orchestra.run.smithi175:osd.4> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T08:16:31.160 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-09-11T08:16:31.160 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-11T08:16:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:30 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:31.923 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-mon[32813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T08:16:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-mon[32813]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T08:16:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:32.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-mon[32813]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:32.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-mon[32813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:32.345 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:16:32.280+0000 7fbacd804640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T08:16:32.345 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:16:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:16:32.285+0000 7fbac863b640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:16:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[29664]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T08:16:32.734 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[29664]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T08:16:32.734 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:32.734 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[29664]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:32.734 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[29664]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:32.735 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[40835]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T08:16:32.735 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[40835]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T08:16:32.735 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:32.735 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[40835]: from='osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:32.735 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:32 smithi173 ceph-mon[40835]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:33.585 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:33 smithi175 ceph-mon[32813]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:33.585 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:33 smithi175 ceph-mon[32813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:33.585 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:33 smithi175 ceph-mon[32813]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T08:16:33.585 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:33.585 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:33 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[29664]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[29664]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[29664]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[40835]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[40835]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[40835]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:33 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:34.207 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-11T08:16:34.302 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-11T08:16:34.316 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-09-11T08:16:34.317 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-09-11T08:16:34.317 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126602 s, 828 MB/s 2024-09-11T08:16:34.317 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-09-11T08:16:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:16:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:16:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] boot 2024-09-11T08:16:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T08:16:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:34 smithi175 ceph-mon[32813]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T08:16:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] boot 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[29664]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: osd.4 [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] boot 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T08:16:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:16:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:34 smithi173 ceph-mon[40835]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T08:16:34.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-09-11T08:16:35.639 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:35.818 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:35.818 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T08:16:35.818 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:35.818 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:35.818 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:35.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:35.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:35.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:35.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:35 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T08:16:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:35 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:36.835 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:36 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi175 2024-09-11T08:16:36.835 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:36 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-11T08:16:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:36 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi175 2024-09-11T08:16:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:36 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-11T08:16:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:36 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi175 2024-09-11T08:16:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:36 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-11T08:16:37.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 -- 172.21.15.175:0/2712123710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f0066bc0 msgr2=0x7f69f00ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:37.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2712123710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f0066bc0 0x7f69f00ff490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f69e4004950 tx=0x7f69e4009da0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 -- 172.21.15.175:0/2712123710 shutdown_connections 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2712123710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f01024c0 0x7f69f0104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2712123710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f00ff9d0 0x7f69f0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2712123710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f0066bc0 0x7f69f00ff490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 -- 172.21.15.175:0/2712123710 >> 172.21.15.175:0/2712123710 conn(0x7f69f00f6ee0 msgr2=0x7f69f00f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 -- 172.21.15.175:0/2712123710 shutdown_connections 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.300+0000 7f69f6c38640 1 -- 172.21.15.175:0/2712123710 wait complete. 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 Processor -- start 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 -- start start 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f0066bc0 0x7f69f010edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f01024c0 0x7f69f0116390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0116960 con 0x7f69f01024c0 2024-09-11T08:16:37.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0116ad0 con 0x7f69f00ff9d0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f6c38640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0116c90 con 0x7f69f0066bc0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69effff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69effff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55438/0 (socket says 172.21.15.175:55438) 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69effff640 1 -- 172.21.15.175:0/2515316767 learned_addr learned my addr 172.21.15.175:0/2515316767 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f51d5640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f01024c0 0x7f69f0116390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.301+0000 7f69f49d4640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f0066bc0 0x7f69f010edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 -- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f0066bc0 msgr2=0x7f69f010edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f0066bc0 0x7f69f010edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 -- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f01024c0 msgr2=0x7f69f0116390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f01024c0 0x7f69f0116390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 -- 172.21.15.175:0/2515316767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4005040 con 0x7f69f00ff9d0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69effff640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69dc002ad0 tx=0x7f69dc004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:16:37.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc007c30 con 0x7f69f00ff9d0 2024-09-11T08:16:37.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f69dc00f040 con 0x7f69f00ff9d0 2024-09-11T08:16:37.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc009340 con 0x7f69f00ff9d0 2024-09-11T08:16:37.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f0116f70 con 0x7f69f00ff9d0 2024-09-11T08:16:37.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.302+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f01173b0 con 0x7f69f00ff9d0 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.303+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f004bf60 con 0x7f69f00ff9d0 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.304+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f69dc0096f0 con 0x7f69f00ff9d0 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.304+0000 7f69ed7fa640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 0x7f69e0071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.304+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3987+0+0 (secure 0 0 0) 0x7f69dc08d900 con 0x7f69f00ff9d0 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.304+0000 7f69f49d4640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 0x7f69e0071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:16:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.305+0000 7f69f49d4640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 0x7f69e0071300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69e40043d0 tx=0x7f69e4035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:16:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.308+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f69dc057360 con 0x7f69f00ff9d0 2024-09-11T08:16:37.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:37.470+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f0102e60 con 0x7f69e006ee50 2024-09-11T08:16:38.008 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:37 smithi175 ceph-mon[32813]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T08:16:38.008 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:37 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:38.008 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:37 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:38.008 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:37 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[29664]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[40835]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:16:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:16:38.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:37 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:39.028 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:38 smithi175 ceph-mon[32813]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:38 smithi173 ceph-mon[29664]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:38 smithi173 ceph-mon[40835]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:16:40.015 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:39 smithi175 ceph-mon[32813]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T08:16:40.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:39 smithi173 ceph-mon[29664]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T08:16:40.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:39 smithi173 ceph-mon[40835]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T08:16:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/1246450107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]': finished 2024-09-11T08:16:41.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T08:16:41.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:41.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/2854008905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/1246450107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]': finished 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/2854008905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/1246450107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]: dispatch 2024-09-11T08:16:41.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7"}]': finished 2024-09-11T08:16:41.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T08:16:41.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:41.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/2854008905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:16:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:41 smithi175 ceph-mon[32813]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T08:16:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:41 smithi173 ceph-mon[29664]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T08:16:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:41 smithi173 ceph-mon[40835]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T08:16:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:43 smithi175 ceph-mon[32813]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:16:44.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:43 smithi173 ceph-mon[29664]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:16:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:43 smithi173 ceph-mon[40835]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:16:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:45 smithi175 ceph-mon[32813]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:16:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:45 smithi173 ceph-mon[29664]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:16:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:45 smithi173 ceph-mon[40835]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:16:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:46 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T08:16:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:46 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:46 smithi175 ceph-mon[32813]: Deploying daemon osd.5 on smithi175 2024-09-11T08:16:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T08:16:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[29664]: Deploying daemon osd.5 on smithi175 2024-09-11T08:16:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T08:16:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:46 smithi173 ceph-mon[40835]: Deploying daemon osd.5 on smithi175 2024-09-11T08:16:48.035 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:47 smithi175 ceph-mon[32813]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:47 smithi173 ceph-mon[29664]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:47 smithi173 ceph-mon[40835]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:50.067 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:49 smithi175 ceph-mon[32813]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:49 smithi173 ceph-mon[29664]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:49 smithi173 ceph-mon[40835]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:51.060 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:51.060 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:51.060 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:50 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:50 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:52.042 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:51 smithi175 ceph-mon[32813]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:51 smithi173 ceph-mon[29664]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:51 smithi173 ceph-mon[40835]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.070 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:53 smithi175 ceph-mon[32813]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.103+0000 7f69ed7fa640 1 -- 172.21.15.175:0/2515316767 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f69f0102e60 con 0x7f69e006ee50 2024-09-11T08:16:54.105 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 msgr2=0x7f69e0071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 0x7f69e0071300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69e40043d0 tx=0x7f69e4035040 comp rx=0 tx=0).stop 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 msgr2=0x7f69f010f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69dc002ad0 tx=0x7f69dc004600 comp rx=0 tx=0).stop 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 shutdown_connections 2024-09-11T08:16:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69f01024c0 0x7f69f0116390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69f00ff9d0 0x7f69f010f330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f69e006ee50 0x7f69e0071300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 --2- 172.21.15.175:0/2515316767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69f0066bc0 0x7f69f010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 >> 172.21.15.175:0/2515316767 conn(0x7f69f00f6ee0 msgr2=0x7f69f00f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 shutdown_connections 2024-09-11T08:16:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:16:54.105+0000 7f69f6c38640 1 -- 172.21.15.175:0/2515316767 wait complete. 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[29664]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:53 smithi173 ceph-mon[40835]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T08:16:54.744 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T08:16:54.746 INFO:tasks.cephadm:Deploying osd.6 on smithi175 with /dev/vg_nvme/lv_2... 2024-09-11T08:16:54.746 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.001 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:54 smithi175 ceph-mon[32813]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T08:16:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[29664]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:54 smithi173 ceph-mon[40835]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:16:55.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:16:55.434+0000 7f5bca3b0640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T08:16:55.728 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:16:55.439+0000 7f5bc61e9640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:16:56.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-mon[32813]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:56.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-mon[32813]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:56.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-mon[32813]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T08:16:56.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[29664]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[29664]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[29664]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[40835]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[40835]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:16:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[40835]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T08:16:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:56.235 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] boot 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T08:16:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] boot 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T08:16:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: osd.5 [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] boot 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T08:16:57.777 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:58.614 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:58 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:16:58.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:58 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:16:58.744 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-11T08:16:58.835 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-11T08:16:58.848 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-09-11T08:16:58.848 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-09-11T08:16:58.848 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120737 s, 868 MB/s 2024-09-11T08:16:58.849 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-09-11T08:16:59.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-09-11T08:16:59.682 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi175 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[29664]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[29664]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[29664]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi175 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-11T08:16:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[40835]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:16:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[40835]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T08:16:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:16:59 smithi173 ceph-mon[40835]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:16:59.803 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:59 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi175 2024-09-11T08:16:59.803 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:59 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-11T08:16:59.803 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:59 smithi175 ceph-mon[32813]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:16:59.803 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:59 smithi175 ceph-mon[32813]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T08:16:59.803 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:16:59 smithi175 ceph-mon[32813]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:17:01.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- 172.21.15.175:0/830215359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fc860 msgr2=0x7fea780fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:01.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/830215359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fc860 0x7fea780fcc70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea68004950 tx=0x7fea68009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- 172.21.15.175:0/830215359 shutdown_connections 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/830215359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fe4e0 0x7fea78104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/830215359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fdb30 0x7fea780fdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/830215359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fc860 0x7fea780fcc70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- 172.21.15.175:0/830215359 >> 172.21.15.175:0/830215359 conn(0x7fea780f8020 msgr2=0x7fea780fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- 172.21.15.175:0/830215359 shutdown_connections 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- 172.21.15.175:0/830215359 wait complete. 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 Processor -- start 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.314+0000 7fea7e8c9640 1 -- start start 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fc860 0x7fea7810cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fdb30 0x7fea7810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:01.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea781146c0 con 0x7fea780fdb30 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78114830 con 0x7fea780fe4e0 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea781149f0 con 0x7fea780fc860 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51784/0 (socket says 172.21.15.175:51784) 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 -- 172.21.15.175:0/3353605414 learned_addr learned my addr 172.21.15.175:0/3353605414 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea777fe640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fdb30 0x7fea7810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea77fff640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fc860 0x7fea7810cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 -- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fc860 msgr2=0x7fea7810cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fc860 0x7fea7810cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 -- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fdb30 msgr2=0x7fea7810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:01.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fdb30 0x7fea7810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 -- 172.21.15.175:0/3353605414 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68005040 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7ce66640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea7000cb90 tx=0x7fea70007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7000a850 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fea7000adf0 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea78114cd0 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70012d80 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.315+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea78115150 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.316+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7804bf60 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.317+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7fea70012540 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.317+0000 7fea74ff9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 0x7fea60071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.317+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4419+0+0 (secure 0 0 0) 0x7fea7008e200 con 0x7fea780fe4e0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.318+0000 7fea77fff640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 0x7fea60071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:01.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.318+0000 7fea77fff640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 0x7fea60071300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea68009040 tx=0x7fea68035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:01.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.321+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea700579f0 con 0x7fea780fe4e0 2024-09-11T08:17:01.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:01.485+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fea781075d0 con 0x7fea6006ee50 2024-09-11T08:17:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:01 smithi173 ceph-mon[29664]: pgmap v129: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:01 smithi173 ceph-mon[40835]: pgmap v129: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:01.793 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:01 smithi175 ceph-mon[32813]: pgmap v129: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[29664]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[40835]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:02 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:02 smithi175 ceph-mon[32813]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:02 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[29664]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[29664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[29664]: Cluster is now healthy 2024-09-11T08:17:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[40835]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[40835]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:03 smithi173 ceph-mon[40835]: Cluster is now healthy 2024-09-11T08:17:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:03 smithi175 ceph-mon[32813]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:03 smithi175 ceph-mon[32813]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:03 smithi175 ceph-mon[32813]: Cluster is now healthy 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3762299520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]': finished 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/1130898227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3762299520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]': finished 2024-09-11T08:17:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T08:17:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/1130898227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3762299520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]: dispatch 2024-09-11T08:17:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac346016-6c9b-45fa-8849-7b87caf51a2e"}]': finished 2024-09-11T08:17:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T08:17:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/1130898227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:05 smithi175 ceph-mon[32813]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T08:17:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:05 smithi173 ceph-mon[29664]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T08:17:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:05 smithi173 ceph-mon[40835]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T08:17:07.890 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:07 smithi175 ceph-mon[32813]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:07 smithi173 ceph-mon[29664]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:07 smithi173 ceph-mon[40835]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:10.052 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:09 smithi175 ceph-mon[32813]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T08:17:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:09 smithi173 ceph-mon[29664]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T08:17:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:09 smithi173 ceph-mon[40835]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-11T08:17:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T08:17:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T08:17:11.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T08:17:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:12.041 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:11 smithi175 ceph-mon[32813]: Deploying daemon osd.6 on smithi175 2024-09-11T08:17:12.041 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:11 smithi175 ceph-mon[32813]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:11 smithi173 ceph-mon[29664]: Deploying daemon osd.6 on smithi175 2024-09-11T08:17:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:11 smithi173 ceph-mon[29664]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:11 smithi173 ceph-mon[40835]: Deploying daemon osd.6 on smithi175 2024-09-11T08:17:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:11 smithi173 ceph-mon[40835]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:13 smithi175 ceph-mon[32813]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:14.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:13 smithi173 ceph-mon[29664]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:13 smithi173 ceph-mon[40835]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:15.792 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[29664]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:15.792 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[40835]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:15.793 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:15 smithi175 ceph-mon[32813]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:18.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:18.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.644+0000 7fea74ff9640 1 -- 172.21.15.175:0/3353605414 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fea781075d0 con 0x7fea6006ee50 2024-09-11T08:17:18.646 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 6 on host 'smithi175' 2024-09-11T08:17:18.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 msgr2=0x7fea60071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:18.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 0x7fea60071300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea68009040 tx=0x7fea68035040 comp rx=0 tx=0).stop 2024-09-11T08:17:18.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 msgr2=0x7fea781140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:18.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea7000cb90 tx=0x7fea70007e40 comp rx=0 tx=0).stop 2024-09-11T08:17:18.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 shutdown_connections 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea780fe4e0 0x7fea781140f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea780fdb30 0x7fea7810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fea6006ee50 0x7fea60071300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 --2- 172.21.15.175:0/3353605414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea780fc860 0x7fea7810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.646+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 >> 172.21.15.175:0/3353605414 conn(0x7fea780f8020 msgr2=0x7fea78100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.647+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 shutdown_connections 2024-09-11T08:17:18.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:18.647+0000 7fea7e8c9640 1 -- 172.21.15.175:0/3353605414 wait complete. 2024-09-11T08:17:19.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:18 smithi175 ceph-mon[32813]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:18 smithi175 ceph-mon[32813]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:19.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.018 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:18 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[29664]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[29664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[40835]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[40835]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:18 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:19.325 DEBUG:teuthology.orchestra.run.smithi175:osd.6> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T08:17:19.328 INFO:tasks.cephadm:Deploying osd.7 on smithi175 with /dev/vg_nvme/lv_1... 2024-09-11T08:17:19.328 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-11T08:17:20.054 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:17:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T08:17:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T08:17:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-mon[32813]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.096 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:17:19.807+0000 7f15e0b83640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T08:17:20.096 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:17:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:17:19.813+0000 7f15dd9be640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[29664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T08:17:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T08:17:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: from='osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:19 smithi173 ceph-mon[40835]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:20.994 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:20 smithi175 ceph-mon[32813]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:20.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:20 smithi175 ceph-mon[32813]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T08:17:20.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:20 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:20.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:20 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[29664]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[29664]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[40835]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[40835]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:20 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] boot 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:21.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:21 smithi175 ceph-mon[32813]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] boot 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[29664]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T08:17:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: osd.6 [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] boot 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:17:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:21 smithi173 ceph-mon[40835]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T08:17:22.720 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-11T08:17:22.817 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-11T08:17:22.835 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-09-11T08:17:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-09-11T08:17:22.836 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0171596 s, 611 MB/s 2024-09-11T08:17:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-09-11T08:17:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:22 smithi175 ceph-mon[32813]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:22 smithi175 ceph-mon[32813]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:17:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:22 smithi175 ceph-mon[32813]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[29664]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[29664]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[29664]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[40835]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[40835]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T08:17:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:22 smithi173 ceph-mon[40835]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T08:17:23.897 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-09-11T08:17:24.141 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:17:24.548 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi175 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:24.549 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:24 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi175 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi175 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-11T08:17:24.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:24.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:24.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:24.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:24 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:25.588 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:25 smithi175 ceph-mon[32813]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:25 smithi173 ceph-mon[29664]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:25 smithi173 ceph-mon[40835]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:25.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/2555090406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fb080 msgr2=0x7f8bd4104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/2555090406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fb080 0x7f8bd4104ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009cd0 tx=0x7f8bcc004d10 comp rx=0 tx=0).stop 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/2555090406 shutdown_connections 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/2555090406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fb080 0x7f8bd4104ec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/2555090406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 0x7f8bd40fa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/2555090406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fdea0 0x7f8bd40fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/2555090406 >> 172.21.15.175:0/2555090406 conn(0x7f8bd40f66a0 msgr2=0x7f8bd40f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/2555090406 shutdown_connections 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/2555090406 wait complete. 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 Processor -- start 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.786+0000 7f8bdb2c3640 1 -- start start 2024-09-11T08:17:25.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fb080 0x7f8bd410c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 0x7f8bd4113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd41144d0 con 0x7f8bd40fe7f0 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4114640 con 0x7f8bd40fdea0 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4114800 con 0x7f8bd40fb080 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59482/0 (socket says 172.21.15.175:59482) 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 -- 172.21.15.175:0/3112769616 learned_addr learned my addr 172.21.15.175:0/3112769616 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd905f640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fb080 0x7f8bd410c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd9860640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 0x7f8bd4113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 -- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fb080 msgr2=0x7f8bd410c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fb080 0x7f8bd410c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:25.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 -- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 msgr2=0x7f8bd4113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 0x7f8bd4113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 -- 172.21.15.175:0/3112769616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0098b0 con 0x7f8bd40fdea0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bd885e640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00028c0 tx=0x7f8bd0004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0007c30 con 0x7f8bd40fdea0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4114ae0 con 0x7f8bd40fdea0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f8bd000f040 con 0x7f8bd40fdea0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.787+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00090d0 con 0x7f8bd40fdea0 2024-09-11T08:17:25.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.788+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4115000 con 0x7f8bd40fdea0 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.789+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd404bf60 con 0x7f8bd40fdea0 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.789+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f8bd000d6b0 con 0x7f8bd40fdea0 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.789+0000 7f8bc5ffb640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 0x7f8bc0071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.790+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4851+0+0 (secure 0 0 0) 0x7f8bd008dbf0 con 0x7f8bd40fdea0 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.790+0000 7f8bd905f640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 0x7f8bc0071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:25.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.790+0000 7f8bd905f640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 0x7f8bc0071300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8004ed0 tx=0x7f8bc800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:25.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.793+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8bd0057100 con 0x7f8bd40fdea0 2024-09-11T08:17:25.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:25.957+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bd4107560 con 0x7f8bc006ee50 2024-09-11T08:17:26.640 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:26 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:26.640 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:26 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:26.640 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:26 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T08:17:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T08:17:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:26 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:27.613 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:27 smithi175 ceph-mon[32813]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:27.613 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:27 smithi175 ceph-mon[32813]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:27.613 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:27 smithi175 ceph-mon[32813]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:27.613 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:27 smithi175 ceph-mon[32813]: Cluster is now healthy 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[29664]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[29664]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[29664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[29664]: Cluster is now healthy 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[40835]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[40835]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[40835]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T08:17:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:27 smithi173 ceph-mon[40835]: Cluster is now healthy 2024-09-11T08:17:28.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/1208524896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]': finished 2024-09-11T08:17:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:28 smithi175 ceph-mon[32813]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T08:17:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:28 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/1208524896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]': finished 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[29664]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/1208524896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]: dispatch 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40563d9-8160-4517-a983-129d55cf216a"}]': finished 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[40835]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T08:17:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:28 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:29 smithi175 ceph-mon[32813]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/2420268713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:29 smithi173 ceph-mon[29664]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/2420268713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:29 smithi173 ceph-mon[40835]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/2420268713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T08:17:31.743 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:31 smithi175 ceph-mon[32813]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:31 smithi173 ceph-mon[29664]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:31 smithi173 ceph-mon[40835]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T08:17:33.813 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:33 smithi175 ceph-mon[32813]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:17:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:33 smithi173 ceph-mon[29664]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:17:33.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:33 smithi173 ceph-mon[40835]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T08:17:34.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T08:17:34.819 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:34 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T08:17:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:34 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T08:17:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:34 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:35.842 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:35 smithi175 ceph-mon[32813]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:35.842 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:35 smithi175 ceph-mon[32813]: Deploying daemon osd.7 on smithi175 2024-09-11T08:17:35.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:35 smithi173 ceph-mon[40835]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:35 smithi173 ceph-mon[40835]: Deploying daemon osd.7 on smithi175 2024-09-11T08:17:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:35 smithi173 ceph-mon[29664]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T08:17:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:35 smithi173 ceph-mon[29664]: Deploying daemon osd.7 on smithi175 2024-09-11T08:17:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:37 smithi175 ceph-mon[32813]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:37 smithi173 ceph-mon[29664]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:37 smithi173 ceph-mon[40835]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:39 smithi175 ceph-mon[32813]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:39 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[40835]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[29664]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:39.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:39 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:41.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:41 smithi175 ceph-mon[32813]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:41.769 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:41 smithi173 ceph-mon[29664]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:41.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:41 smithi173 ceph-mon[40835]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:42.825 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 7 on host 'smithi175' 2024-09-11T08:17:42.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.824+0000 7f8bc5ffb640 1 -- 172.21.15.175:0/3112769616 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8bd4107560 con 0x7f8bc006ee50 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 msgr2=0x7f8bc0071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 0x7f8bc0071300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8004ed0 tx=0x7f8bc800b040 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 msgr2=0x7f8bd410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00028c0 tx=0x7f8bd0004570 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 shutdown_connections 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd40fe7f0 0x7f8bd4113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bd40fdea0 0x7f8bd410cea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8bc006ee50 0x7f8bc0071300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 --2- 172.21.15.175:0/3112769616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd40fb080 0x7f8bd410c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 >> 172.21.15.175:0/3112769616 conn(0x7f8bd40f66a0 msgr2=0x7f8bd40f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 shutdown_connections 2024-09-11T08:17:42.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:42.826+0000 7f8bdb2c3640 1 -- 172.21.15.175:0/3112769616 wait complete. 2024-09-11T08:17:43.419 DEBUG:teuthology.orchestra.run.smithi175:osd.7> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T08:17:43.422 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-11T08:17:43.422 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T08:17:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[29664]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[29664]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[29664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[40835]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[40835]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[40835]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:43 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:43 smithi175 ceph-mon[32813]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:43 smithi175 ceph-mon[32813]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:43 smithi175 ceph-mon[32813]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T08:17:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:43 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:43 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.566 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.566 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:17:44.521+0000 7f214b007640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T08:17:44.566 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:17:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:17:44.528+0000 7f214663f640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T08:17:44.885 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T08:17:44.885 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T08:17:44.885 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:44.886 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.886 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.886 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.886 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:44.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:44 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.373+0000 7fc23dbf9640 1 -- 172.21.15.173:0/3967038092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fca10 msgr2=0x7fc2380fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/3967038092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fca10 0x7fc2380fce80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc22c004890 tx=0x7fc22c009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- 172.21.15.173:0/3967038092 shutdown_connections 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/3967038092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fd3c0 0x7fc238103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/3967038092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fca10 0x7fc2380fce80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/3967038092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fb740 0x7fc2380fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- 172.21.15.173:0/3967038092 >> 172.21.15.173:0/3967038092 conn(0x7fc2380f6ee0 msgr2=0x7fc2380f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- 172.21.15.173:0/3967038092 shutdown_connections 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- 172.21.15.173:0/3967038092 wait complete. 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 Processor -- start 2024-09-11T08:17:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- start start 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fd3c0 0x7fc238113110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381136e0 con 0x7fc2380fb740 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238113850 con 0x7fc2380fd3c0 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.374+0000 7fc23dbf9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238113a10 con 0x7fc2380fca10 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46296/0 (socket says 172.21.15.173:46296) 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37970/0 (socket says 172.21.15.173:37970) 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc236ffd640 1 -- 172.21.15.173:0/2907631283 learned_addr learned my addr 172.21.15.173:0/2907631283 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc237fff640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fd3c0 0x7fc238113110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 -- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 msgr2=0x7fc23810c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 -- 172.21.15.173:0/2907631283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fd3c0 msgr2=0x7fc238113110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fd3c0 0x7fc238113110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 -- 172.21.15.173:0/2907631283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300098b0 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc236ffd640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc2377fe640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc22800b560 tx=0x7fc228009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800f510 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fc22800fab0 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c005040 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228011920 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.375+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc238114030 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.376+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23804bf60 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.377+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7fc22800f670 con 0x7fc2380fb740 2024-09-11T08:17:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.377+0000 7fc21ffff640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 0x7fc220071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:45.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.377+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5003+0+0 (secure 0 0 0) 0x7fc22808db00 con 0x7fc2380fb740 2024-09-11T08:17:45.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.377+0000 7fc236ffd640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 0x7fc220071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:45.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.378+0000 7fc236ffd640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 0x7fc220071300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc23810d070 tx=0x7fc22c009da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:45.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.382+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc228057000 con 0x7fc2380fb740 2024-09-11T08:17:45.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.542+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc238106540 con 0x7fc2380fb740 2024-09-11T08:17:45.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.543+0000 7fc21ffff640 1 -- 172.21.15.173:0/2907631283 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v49) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc22805a810 con 0x7fc2380fb740 2024-09-11T08:17:45.543 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 msgr2=0x7fc220071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 0x7fc220071300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc23810d070 tx=0x7fc22c009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 msgr2=0x7fc23810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc22800b560 tx=0x7fc228009120 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 shutdown_connections 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2380fd3c0 0x7fc238113110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7fc22006ee50 0x7fc220071300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2380fca10 0x7fc23810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 --2- 172.21.15.173:0/2907631283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2380fb740 0x7fc23810bb70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:45.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 >> 172.21.15.173:0/2907631283 conn(0x7fc2380f6ee0 msgr2=0x7fc2380f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:45.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 shutdown_connections 2024-09-11T08:17:45.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:45.545+0000 7fc23dbf9640 1 -- 172.21.15.173:0/2907631283 wait complete. 2024-09-11T08:17:45.762 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:45.762 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:45.762 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T08:17:45.763 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.763 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.763 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] boot 2024-09-11T08:17:45.763 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T08:17:45.763 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:45 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:45.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:45.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T08:17:45.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] boot 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: osd.7 [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] boot 2024-09-11T08:17:45.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T08:17:45.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:45 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:17:46.192 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1726042665,"num_in_osds":8,"osd_in_since":1726042648,"num_remapped_pgs":1} 2024-09-11T08:17:46.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T08:17:46.436 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:17:46.828 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[29664]: purged_snaps scrub starts 2024-09-11T08:17:46.828 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[29664]: purged_snaps scrub ok 2024-09-11T08:17:46.828 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2907631283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T08:17:46.828 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[29664]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T08:17:46.829 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[40835]: purged_snaps scrub starts 2024-09-11T08:17:46.829 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[40835]: purged_snaps scrub ok 2024-09-11T08:17:46.829 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2907631283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T08:17:46.829 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:46 smithi173 ceph-mon[40835]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T08:17:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:46 smithi175 ceph-mon[32813]: purged_snaps scrub starts 2024-09-11T08:17:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:46 smithi175 ceph-mon[32813]: purged_snaps scrub ok 2024-09-11T08:17:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2907631283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T08:17:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:46 smithi175 ceph-mon[32813]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[40835]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.659 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:47 smithi173 ceph-mon[29664]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T08:17:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:47.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:47 smithi175 ceph-mon[32813]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 -- 172.21.15.173:0/3849414989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23080fca50 msgr2=0x7f23080fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 --2- 172.21.15.173:0/3849414989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23080fca50 0x7f23080fcec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22fc004980 tx=0x7f22fc009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 -- 172.21.15.173:0/3849414989 shutdown_connections 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 --2- 172.21.15.173:0/3849414989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fd400 0x7f2308109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 --2- 172.21.15.173:0/3849414989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23080fca50 0x7f23080fcec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 --2- 172.21.15.173:0/3849414989 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23081028e0 0x7f2308102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 -- 172.21.15.173:0/3849414989 >> 172.21.15.173:0/3849414989 conn(0x7f2308073600 msgr2=0x7f2308073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.153+0000 7f230e94f640 1 -- 172.21.15.173:0/3849414989 shutdown_connections 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 -- 172.21.15.173:0/3849414989 wait complete. 2024-09-11T08:17:48.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 Processor -- start 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 -- start start 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fca50 0x7f2308112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 0x7f230810cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230810d400 con 0x7f23081028e0 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230810d570 con 0x7f23080fca50 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230e94f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230810d730 con 0x7f23080fd400 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f23077fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f230ceec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 0x7f230810cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.154+0000 7f23077fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46310/0 (socket says 172.21.15.173:46310) 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f23077fe640 1 -- 172.21.15.173:0/1581617479 learned_addr learned my addr 172.21.15.173:0/1581617479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f2307fff640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fca50 0x7f2308112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:48.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 -- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 msgr2=0x7f2308113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 -- 172.21.15.173:0/1581617479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fca50 msgr2=0x7f2308112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fca50 0x7f2308112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 -- 172.21.15.173:0/1581617479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc005040 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f23077fe640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230ceec640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 0x7f230810cdb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f230000c910 tx=0x7f2300007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000cea0 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230810da10 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f230000ac90 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300012b30 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.155+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2308119c10 con 0x7f23081028e0 2024-09-11T08:17:48.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.156+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23080fe000 con 0x7f23081028e0 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.157+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f230000a850 con 0x7f23081028e0 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.157+0000 7f2304ff9640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 0x7f22f00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.157+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5283+0+0 (secure 0 0 0) 0x7f230008e480 con 0x7f23081028e0 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.157+0000 7f2307fff640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 0x7f22f00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.158+0000 7f2307fff640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 0x7f22f00712d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22f8004a70 tx=0x7f22f800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:48.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.161+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f23000577e0 con 0x7f23081028e0 2024-09-11T08:17:48.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.319+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f230810bbf0 con 0x7f23081028e0 2024-09-11T08:17:48.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.320+0000 7f2304ff9640 1 -- 172.21.15.173:0/1581617479 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13270 (secure 0 0 0) 0x7f230005aff0 con 0x7f23081028e0 2024-09-11T08:17:48.321 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:17:48.321 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":51,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","created":"2024-09-11T08:12:48.743200+0000","modified":"2024-09-11T08:17:47.519816+0000","last_up_change":"2024-09-11T08:17:45.517195+0000","last_in_change":"2024-09-11T08:17:28.274408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T08:15:48.540348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1ab3b916-d9b5-4d36-b89e-555941b2ef9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6803","nonce":3725419528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6805","nonce":3725419528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6809","nonce":3725419528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6807","nonce":3725419528}]},"public_addr":"172.21.15.173:6803/3725419528","cluster_addr":"172.21.15.173:6805/3725419528","heartbeat_back_addr":"172.21.15.173:6809/3725419528","heartbeat_front_addr":"172.21.15.173:6807/3725419528","state":["exists","up"]},{"osd":1,"uuid":"8052c26f-b90b-4c4a-a1ef-02090406b450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6811","nonce":2339789859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6813","nonce":2339789859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6817","nonce":2339789859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6815","nonce":2339789859}]},"public_addr":"172.21.15.173:6811/2339789859","cluster_addr":"172.21.15.173:6813/2339789859","heartbeat_back_addr":"172.21.15.173:6817/2339789859","heartbeat_front_addr":"172.21.15.173:6815/2339789859","state":["exists","up"]},{"osd":2,"uuid":"c2086bc5-1352-4a1a-84fd-46bfb860441a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6819","nonce":151053591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6821","nonce":151053591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6825","nonce":151053591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6823","nonce":151053591}]},"public_addr":"172.21.15.173:6819/151053591","cluster_addr":"172.21.15.173:6821/151053591","heartbeat_back_addr":"172.21.15.173:6825/151053591","heartbeat_front_addr":"172.21.15.173:6823/151053591","state":["exists","up"]},{"osd":3,"uuid":"08e67f5c-571e-4e76-b3c3-e47e87fd436a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6827","nonce":643295685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6829","nonce":643295685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6833","nonce":643295685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6831","nonce":643295685}]},"public_addr":"172.21.15.173:6827/643295685","cluster_addr":"172.21.15.173:6829/643295685","heartbeat_back_addr":"172.21.15.173:6833/643295685","heartbeat_front_addr":"172.21.15.173:6831/643295685","state":["exists","up"]},{"osd":4,"uuid":"6730fe3b-6d6e-4091-9eed-11e18864e1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6801","nonce":1661927425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6803","nonce":1661927425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6807","nonce":1661927425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6805","nonce":1661927425}]},"public_addr":"172.21.15.175:6801/1661927425","cluster_addr":"172.21.15.175:6803/1661927425","heartbeat_back_addr":"172.21.15.175:6807/1661927425","heartbeat_front_addr":"172.21.15.175:6805/1661927425","state":["exists","up"]},{"osd":5,"uuid":"b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6809","nonce":3173894990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6811","nonce":3173894990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6815","nonce":3173894990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6813","nonce":3173894990}]},"public_addr":"172.21.15.175:6809/3173894990","cluster_addr":"172.21.15.175:6811/3173894990","heartbeat_back_addr":"172.21.15.175:6815/3173894990","heartbeat_front_addr":"172.21.15.175:6813/3173894990","state":["exists","up"]},{"osd":6,"uuid":"ac346016-6c9b-45fa-8849-7b87caf51a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6817","nonce":2487468341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6819","nonce":2487468341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6823","nonce":2487468341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6821","nonce":2487468341}]},"public_addr":"172.21.15.175:6817/2487468341","cluster_addr":"172.21.15.175:6819/2487468341","heartbeat_back_addr":"172.21.15.175:6823/2487468341","heartbeat_front_addr":"172.21.15.175:6821/2487468341","state":["exists","up"]},{"osd":7,"uuid":"b40563d9-8160-4517-a983-129d55cf216a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6825","nonce":3505122552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6827","nonce":3505122552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6831","nonce":3505122552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6829","nonce":3505122552}]},"public_addr":"172.21.15.175:6825/3505122552","cluster_addr":"172.21.15.175:6827/3505122552","heartbeat_back_addr":"172.21.15.175:6831/3505122552","heartbeat_front_addr":"172.21.15.175:6829/3505122552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:14:58.838772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:22.257022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:45.382906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:09.808893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:31.379056+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:54.710183+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:19.124216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:43.574635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6801/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/2233640548":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/896925606":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/3081945920":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/60027638":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/932764076":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/1191247772":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6801/2991830914":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6800/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:6800/2991830914":"2024-09-12T08:13:16.827305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T08:17:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 msgr2=0x7f22f00712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 0x7f22f00712d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22f8004a70 tx=0x7f22f800b040 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 msgr2=0x7f230810cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 0x7f230810cdb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f230000c910 tx=0x7f2300007cf0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 shutdown_connections 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23081028e0 0x7f230810cdb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f22f006ee20 0x7f22f00712d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23080fd400 0x7f2308113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 --2- 172.21.15.173:0/1581617479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23080fca50 0x7f2308112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 >> 172.21.15.173:0/1581617479 conn(0x7f2308073600 msgr2=0x7f23080fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 shutdown_connections 2024-09-11T08:17:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:48.322+0000 7f230e94f640 1 -- 172.21.15.173:0/1581617479 wait complete. 2024-09-11T08:17:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[29664]: Detected new or changed devices on smithi175 2024-09-11T08:17:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-11T08:17:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1581617479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:17:48.723 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[40835]: Detected new or changed devices on smithi175 2024-09-11T08:17:48.723 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-11T08:17:48.723 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1581617479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:17:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:48 smithi175 ceph-mon[32813]: Detected new or changed devices on smithi175 2024-09-11T08:17:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:48 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-11T08:17:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1581617479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:17:49.014 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T08:15:48.540348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-11T08:17:49.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T08:17:49.254 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:17:49.651 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:49 smithi173 ceph-mon[29664]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:49.652 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:49 smithi173 ceph-mon[40835]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:49 smithi175 ceph-mon[32813]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 -- 172.21.15.173:0/1056196115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 msgr2=0x7f4fec109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 --2- 172.21.15.173:0/1056196115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec109710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009cd0 tx=0x7f4fe4004d10 comp rx=0 tx=0).stop 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 -- 172.21.15.173:0/1056196115 shutdown_connections 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 --2- 172.21.15.173:0/1056196115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec109710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 --2- 172.21.15.173:0/1056196115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec066430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 --2- 172.21.15.173:0/1056196115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 0x7f4fec102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 -- 172.21.15.173:0/1056196115 >> 172.21.15.173:0/1056196115 conn(0x7f4fec070380 msgr2=0x7f4fec070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:51.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 -- 172.21.15.173:0/1056196115 shutdown_connections 2024-09-11T08:17:51.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.003+0000 7f4ff1152640 1 -- 172.21.15.173:0/1056196115 wait complete. 2024-09-11T08:17:51.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 Processor -- start 2024-09-11T08:17:51.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 -- start start 2024-09-11T08:17:51.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 0x7f4fec10cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec10d230 con 0x7f4fec065fe0 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec10d3a0 con 0x7f4fec1029a0 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4ff1152640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec10d560 con 0x7f4fec066970 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fea59c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38002/0 (socket says 172.21.15.173:38002) 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 -- 172.21.15.173:0/4241858894 learned_addr learned my addr 172.21.15.173:0/4241858894 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4feb59e640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 0x7f4fec10cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 -- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 msgr2=0x7f4fec112f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec112f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 -- 172.21.15.173:0/4241858894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 msgr2=0x7f4fec10cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 0x7f4fec10cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fead9d640 1 -- 172.21.15.173:0/4241858894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4005040 con 0x7f4fec065fe0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.004+0000 7f4fea59c640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4fead9d640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc002ad0 tx=0x7f4fdc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc007c30 con 0x7f4fec065fe0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40098b0 con 0x7f4fec065fe0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f4fdc00f040 con 0x7f4fec065fe0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc009340 con 0x7f4fec065fe0 2024-09-11T08:17:51.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.005+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec1198a0 con 0x7f4fec065fe0 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.006+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0fe080 con 0x7f4fec065fe0 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.007+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f4fdc009770 con 0x7f4fec065fe0 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.007+0000 7f4fe37fe640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 0x7f4fd80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.007+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5283+0+0 (secure 0 0 0) 0x7f4fdc08dd50 con 0x7f4fec065fe0 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.007+0000 7f4fea59c640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 0x7f4fd80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:51.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.008+0000 7f4fea59c640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 0x7f4fd80712d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4fec10e310 tx=0x7f4fd400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:51.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.011+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4fdc091030 con 0x7f4fec065fe0 2024-09-11T08:17:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.168+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fec10bbe0 con 0x7f4fec065fe0 2024-09-11T08:17:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.168+0000 7f4fe37fe640 1 -- 172.21.15.173:0/4241858894 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fdc057220 con 0x7f4fec065fe0 2024-09-11T08:17:51.169 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-09-11T08:17:51.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 msgr2=0x7f4fd80712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:51.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 0x7f4fd80712d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4fec10e310 tx=0x7f4fd400b040 comp rx=0 tx=0).stop 2024-09-11T08:17:51.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 msgr2=0x7f4fec112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc002ad0 tx=0x7f4fdc004600 comp rx=0 tx=0).stop 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 shutdown_connections 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fec1029a0 0x7f4fec10cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f4fd806ee20 0x7f4fd80712d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec066970 0x7f4fec112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 --2- 172.21.15.173:0/4241858894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec065fe0 0x7f4fec112a50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 >> 172.21.15.173:0/4241858894 conn(0x7f4fec070380 msgr2=0x7f4fec0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 shutdown_connections 2024-09-11T08:17:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:17:51.170+0000 7f4ff1152640 1 -- 172.21.15.173:0/4241858894 wait complete. 2024-09-11T08:17:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:51 smithi175 ceph-mon[32813]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4241858894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T08:17:51.879 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:51 smithi173 ceph-mon[29664]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:51.879 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4241858894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T08:17:51.879 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:51 smithi173 ceph-mon[40835]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:51.879 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4241858894' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T08:17:51.904 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi173 2024-09-11T08:17:51.904 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi173=foo.a' 2024-09-11T08:17:52.153 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:17:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:53 smithi175 ceph-mon[32813]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3608613974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c780ff9b0 msgr2=0x7f9c78101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3608613974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c780ff9b0 0x7f9c78101d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c004950 tx=0x7f9c6c009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3608613974 shutdown_connections 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3608613974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781024c0 0x7f9c78104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3608613974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c780ff9b0 0x7f9c78101d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3608613974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c78065f10 0x7f9c780ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3608613974 >> 172.21.15.175:0/3608613974 conn(0x7f9c780f6f20 msgr2=0x7f9c780f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3608613974 shutdown_connections 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3608613974 wait complete. 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.883+0000 7f9c7ded9640 1 Processor -- start 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 -- start start 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c78065f10 0x7f9c7810cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c780ff9b0 0x7f9c7810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c781146e0 con 0x7f9c780ff9b0 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78114850 con 0x7f9c781024c0 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78114a10 con 0x7f9c78065f10 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33678/0 (socket says 172.21.15.175:33678) 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 -- 172.21.15.175:0/3176875585 learned_addr learned my addr 172.21.15.175:0/3176875585 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:17:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c777fe640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c78065f10 0x7f9c7810cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c76ffd640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c780ff9b0 0x7f9c7810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 -- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c78065f10 msgr2=0x7f9c7810cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c78065f10 0x7f9c7810cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 -- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c780ff9b0 msgr2=0x7f9c7810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c780ff9b0 0x7f9c7810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 -- 172.21.15.175:0/3176875585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c005040 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c77fff640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000db80 tx=0x7f9c70004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70017070 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c78114cf0 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f9c7000f040 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.884+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700036a0 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.885+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c78115190 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.886+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c78107c40 con 0x7f9c781024c0 2024-09-11T08:17:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.886+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f9c70003a50 con 0x7f9c781024c0 2024-09-11T08:17:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.886+0000 7f9c5ffff640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 0x7f9c60071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.887+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5283+0+0 (secure 0 0 0) 0x7f9c7008dfb0 con 0x7f9c781024c0 2024-09-11T08:17:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.887+0000 7f9c777fe640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 0x7f9c60071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.887+0000 7f9c777fe640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 0x7f9c60071300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c78065c70 tx=0x7f9c68009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:53.891+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c700573c0 con 0x7f9c781024c0 2024-09-11T08:17:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:53 smithi173 ceph-mon[29664]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:53 smithi173 ceph-mon[40835]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:54.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.054+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi173=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c781074c0 con 0x7f9c6006ee50 2024-09-11T08:17:54.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.061+0000 7f9c5ffff640 1 -- 172.21.15.175:0/3176875585 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f9c781074c0 con 0x7f9c6006ee50 2024-09-11T08:17:54.062 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled rgw.foo.a update... 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 msgr2=0x7f9c60071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 0x7f9c60071300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c78065c70 tx=0x7f9c68009040 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 msgr2=0x7f9c78114110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000db80 tx=0x7f9c70004e60 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 shutdown_connections 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c781024c0 0x7f9c78114110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c780ff9b0 0x7f9c7810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f9c6006ee50 0x7f9c60071300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 --2- 172.21.15.175:0/3176875585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c78065f10 0x7f9c7810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 >> 172.21.15.175:0/3176875585 conn(0x7f9c780f6f20 msgr2=0x7f9c780fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:54.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 shutdown_connections 2024-09-11T08:17:54.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:54.063+0000 7f9c7ded9640 1 -- 172.21.15.175:0/3176875585 wait complete. 2024-09-11T08:17:54.678 DEBUG:teuthology.orchestra.run.smithi173:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@rgw.foo.a.service 2024-09-11T08:17:54.680 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi175 2024-09-11T08:17:54.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-09-11T08:17:54.921 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi173=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.295 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-11T08:17:55.296 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-11T08:17:55.296 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.296 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.296 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: Deploying daemon rgw.foo.a on smithi173 2024-09-11T08:17:55.296 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:55 smithi175 ceph-mon[32813]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi173=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: Deploying daemon rgw.foo.a on smithi173 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[40835]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi173=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-11T08:17:55.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-11T08:17:55.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:55.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:55.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: Deploying daemon rgw.foo.a on smithi173 2024-09-11T08:17:55.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:55 smithi173 ceph-mon[29664]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:55.950 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:55 smithi173 systemd[1]: Starting Ceph rgw.foo.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:17:56.217 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 podman[69517]: 2024-09-11 08:17:56.060458671 +0000 UTC m=+0.015969501 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:17:56.217 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 podman[69517]: 2024-09-11 08:17:56.17131856 +0000 UTC m=+0.126829382 container create 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- 172.21.15.175:0/1447422208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fca10 msgr2=0x7f769c0fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 --2- 172.21.15.175:0/1447422208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fca10 0x7f769c0fce80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7684004950 tx=0x7f7684009da0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- 172.21.15.175:0/1447422208 shutdown_connections 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 --2- 172.21.15.175:0/1447422208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fd3c0 0x7f769c103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 --2- 172.21.15.175:0/1447422208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fca10 0x7f769c0fce80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 --2- 172.21.15.175:0/1447422208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c0fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- 172.21.15.175:0/1447422208 >> 172.21.15.175:0/1447422208 conn(0x7f769c0f6f00 msgr2=0x7f769c0f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- 172.21.15.175:0/1447422208 shutdown_connections 2024-09-11T08:17:56.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- 172.21.15.175:0/1447422208 wait complete. 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 Processor -- start 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.498+0000 7f76a1c55640 1 -- start start 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c10cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fca10 0x7f769c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1146c0 con 0x7f769c0fca10 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c114830 con 0x7f769c0fd3c0 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1149f0 con 0x7f769c0fb740 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f7693fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fca10 0x7f769c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c10cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:56.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54914/0 (socket says 172.21.15.175:54914) 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 -- 172.21.15.175:0/3304653389 learned_addr learned my addr 172.21.15.175:0/3304653389 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 -- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 msgr2=0x7f769c10cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c10cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 -- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fca10 msgr2=0x7f769c10d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fca10 0x7f769c10d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 -- 172.21.15.175:0/3304653389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684005040 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769b7fe640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f769bfff640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f769400cb90 tx=0x7f7694007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400a850 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f769400adf0 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c114cd0 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694012d80 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.499+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c115170 con 0x7f769c0fd3c0 2024-09-11T08:17:56.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.500+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c04bf60 con 0x7f769c0fd3c0 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.501+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f7694012540 con 0x7f769c0fd3c0 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.501+0000 7f7698ff9640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 0x7f7688071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.502+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5283+0+0 (secure 0 0 0) 0x7f769408e4f0 con 0x7f769c0fd3c0 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.502+0000 7f769b7fe640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 0x7f7688071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.502+0000 7f769b7fe640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 0x7f7688071300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f768c009d70 tx=0x7f768c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:17:56.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.505+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7694057980 con 0x7f769c0fd3c0 2024-09-11T08:17:56.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:56.661+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7f769c1154a0 con 0x7f769c0fd3c0 2024-09-11T08:17:56.717 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 podman[69517]: 2024-09-11 08:17:56.407256568 +0000 UTC m=+0.362767391 container init 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T08:17:56.717 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 podman[69517]: 2024-09-11 08:17:56.412298635 +0000 UTC m=+0.367809453 container start 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T08:17:56.717 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 bash[69517]: 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f 2024-09-11T08:17:56.717 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:17:56 smithi173 systemd[1]: Started Ceph rgw.foo.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:17:57.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.348+0000 7f7698ff9640 1 -- 172.21.15.175:0/3304653389 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v52) v1 ==== 160+0+0 (secure 0 0 0) 0x7f769405b190 con 0x7f769c0fd3c0 2024-09-11T08:17:57.349 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'datapool' created 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 msgr2=0x7f7688071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 0x7f7688071300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f768c009d70 tx=0x7f768c00b040 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 msgr2=0x7f769c1140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f769400cb90 tx=0x7f7694007e40 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 shutdown_connections 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769c0fd3c0 0x7f769c1140f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f769c0fca10 0x7f769c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f768806ee50 0x7f7688071300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 --2- 172.21.15.175:0/3304653389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f769c0fb740 0x7f769c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 >> 172.21.15.175:0/3304653389 conn(0x7f769c0f6f00 msgr2=0x7f769c065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:17:57.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 shutdown_connections 2024-09-11T08:17:57.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:17:57.351+0000 7f76a1c55640 1 -- 172.21.15.175:0/3304653389 wait complete. 2024-09-11T08:17:57.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:57.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3304653389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.593 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3304653389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:57 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3304653389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:57.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:57 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:17:58.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- rbd pool init datapool 2024-09-11T08:17:58.263 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:17:58.638 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:58 smithi175 ceph-mon[32813]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:58.639 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-11T08:17:58.639 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:58 smithi175 ceph-mon[32813]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T08:17:58.639 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[29664]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[29664]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[40835]: Saving service rgw.foo.a spec with placement smithi173=foo.a;count:1 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[40835]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T08:17:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-11T08:17:59.350 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: pgmap v171: 36 pgs: 8 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:59.350 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:17:59.350 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-11T08:17:59.350 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: osdmap e53: 8 total, 8 up, 8 in 2024-09-11T08:17:59.350 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:59.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:59.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:17:59 smithi175 ceph-mon[32813]: Checking dashboard <-> RGW credentials 2024-09-11T08:17:59.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: pgmap v171: 36 pgs: 8 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: osdmap e53: 8 total, 8 up, 8 in 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[40835]: Checking dashboard <-> RGW credentials 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: pgmap v171: 36 pgs: 8 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:17:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: osdmap e53: 8 total, 8 up, 8 in 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:17:59.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:17:59 smithi173 ceph-mon[29664]: Checking dashboard <-> RGW credentials 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: osdmap e54: 8 total, 8 up, 8 in 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3261563412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: osdmap e54: 8 total, 8 up, 8 in 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3261563412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:00 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: osdmap e54: 8 total, 8 up, 8 in 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3261563412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-11T08:18:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:00 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[29664]: pgmap v174: 68 pgs: 13 creating+peering, 46 unknown, 9 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[29664]: osdmap e55: 8 total, 8 up, 8 in 2024-09-11T08:18:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[40835]: pgmap v174: 68 pgs: 13 creating+peering, 46 unknown, 9 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-11T08:18:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-11T08:18:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:01 smithi173 ceph-mon[40835]: osdmap e55: 8 total, 8 up, 8 in 2024-09-11T08:18:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:01 smithi175 ceph-mon[32813]: pgmap v174: 68 pgs: 13 creating+peering, 46 unknown, 9 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-11T08:18:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-11T08:18:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-11T08:18:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:01 smithi175 ceph-mon[32813]: osdmap e55: 8 total, 8 up, 8 in 2024-09-11T08:18:02.690 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:02 smithi175 ceph-mon[32813]: osdmap e56: 8 total, 8 up, 8 in 2024-09-11T08:18:02.690 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:02.690 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[29664]: osdmap e56: 8 total, 8 up, 8 in 2024-09-11T08:18:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[40835]: osdmap e56: 8 total, 8 up, 8 in 2024-09-11T08:18:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-11T08:18:03.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.175 --placement '1;smithi175=iscsi.a' 2024-09-11T08:18:03.397 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:03.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:03 smithi175 ceph-mon[32813]: pgmap v177: 100 pgs: 21 creating+peering, 41 unknown, 38 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T08:18:03.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.661 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:03 smithi175 ceph-mon[32813]: osdmap e57: 8 total, 8 up, 8 in 2024-09-11T08:18:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[29664]: pgmap v177: 100 pgs: 21 creating+peering, 41 unknown, 38 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[29664]: osdmap e57: 8 total, 8 up, 8 in 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[40835]: pgmap v177: 100 pgs: 21 creating+peering, 41 unknown, 38 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.0 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/912965793' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2838043608' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-11T08:18:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:03 smithi173 ceph-mon[40835]: osdmap e57: 8 total, 8 up, 8 in 2024-09-11T08:18:04.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:04 smithi175 ceph-mon[32813]: osdmap e58: 8 total, 8 up, 8 in 2024-09-11T08:18:04.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.565 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.566 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.566 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:04 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[29664]: osdmap e58: 8 total, 8 up, 8 in 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[40835]: osdmap e58: 8 total, 8 up, 8 in 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-11T08:18:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:04 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 -- 172.21.15.175:0/3324155513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fc860 msgr2=0x7f1ad00fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/3324155513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fc860 0x7f1ad00fcc70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0004950 tx=0x7f1ac0009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 -- 172.21.15.175:0/3324155513 shutdown_connections 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/3324155513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fe4e0 0x7f1ad0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/3324155513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fdb30 0x7f1ad00fdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/3324155513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fc860 0x7f1ad00fcc70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 -- 172.21.15.175:0/3324155513 >> 172.21.15.175:0/3324155513 conn(0x7f1ad00f8020 msgr2=0x7f1ad00fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 -- 172.21.15.175:0/3324155513 shutdown_connections 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.027+0000 7f1ad5a06640 1 -- 172.21.15.175:0/3324155513 wait complete. 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 Processor -- start 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 -- start start 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 0x7f1ad010cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 0x7f1ad01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0114690 con 0x7f1ad00fe4e0 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0114800 con 0x7f1ad00fdb30 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ad5a06640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01149c0 con 0x7f1ad00fc860 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34678/0 (socket says 172.21.15.175:34678) 2024-09-11T08:18:05.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 -- 172.21.15.175:0/868312841 learned_addr learned my addr 172.21.15.175:0/868312841 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1acf7fe640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 0x7f1ad01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1aceffd640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 0x7f1ad010cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 -- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 msgr2=0x7f1ad010cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 0x7f1ad010cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 -- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 msgr2=0x7f1ad01140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 0x7f1ad01140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 -- 172.21.15.175:0/868312841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0005040 con 0x7f1ad00fdb30 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1acf7fe640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 0x7f1ad01140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1aceffd640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 0x7f1ad010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ace7fc640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c890 tx=0x7f1ac4007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.028+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400ce20 con 0x7f1ad00fdb30 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.029+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f1ac400ac90 con 0x7f1ad00fdb30 2024-09-11T08:18:05.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.029+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0114ca0 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.029+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4012b80 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.029+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0115170 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.029+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad004bf60 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.030+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f1ac400a850 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.030+0000 7f1ab77fe640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 0x7f1ab8071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.031+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7128+0+0 (secure 0 0 0) 0x7f1ac408e750 con 0x7f1ad00fdb30 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.031+0000 7f1aceffd640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 0x7f1ab8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.031+0000 7f1aceffd640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 0x7f1ab8071300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002d040 tx=0x7f1ac0035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:05.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.034+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ac4057400 con 0x7f1ad00fdb30 2024-09-11T08:18:05.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.197+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.175", "placement": "1;smithi175=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad005db50 con 0x7f1ab806ee50 2024-09-11T08:18:05.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.205+0000 7f1ab77fe640 1 -- 172.21.15.175:0/868312841 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f1ad005db50 con 0x7f1ab806ee50 2024-09-11T08:18:05.205 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled iscsi.datapool update... 2024-09-11T08:18:05.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 msgr2=0x7f1ab8071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:05.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 0x7f1ab8071300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002d040 tx=0x7f1ac0035040 comp rx=0 tx=0).stop 2024-09-11T08:18:05.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 msgr2=0x7f1ad010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c890 tx=0x7f1ac4007f50 comp rx=0 tx=0).stop 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 shutdown_connections 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ad00fe4e0 0x7f1ad01140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad00fdb30 0x7f1ad010d0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1ab806ee50 0x7f1ab8071300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 --2- 172.21.15.175:0/868312841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ad00fc860 0x7f1ad010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 >> 172.21.15.175:0/868312841 conn(0x7f1ad00f8020 msgr2=0x7f1ad00fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 shutdown_connections 2024-09-11T08:18:05.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:05.207+0000 7f1ad5a06640 1 -- 172.21.15.175:0/868312841 wait complete. 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: pgmap v180: 132 pgs: 13 creating+peering, 56 unknown, 63 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: osdmap e59: 8 total, 8 up, 8 in 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.571 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.572 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.572 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:05 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: pgmap v180: 132 pgs: 13 creating+peering, 56 unknown, 63 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: osdmap e59: 8 total, 8 up, 8 in 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: pgmap v180: 132 pgs: 13 creating+peering, 56 unknown, 63 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: osdmap e59: 8 total, 8 up, 8 in 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3722446949' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-11T08:18:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:05 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:05.932 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-11T08:18:05.932 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:18:05.932 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-11T08:18:05.961 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:18:05.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-11T08:18:05.990 DEBUG:teuthology.orchestra.run.smithi175:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service 2024-09-11T08:18:06.033 INFO:tasks.cephadm:Adding prometheus.a on smithi175 2024-09-11T08:18:06.034 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply prometheus '1;smithi175=a' 2024-09-11T08:18:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.175", "placement": "1;smithi175=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: Saving service iscsi.datapool spec with placement smithi175=iscsi.a;count:1 2024-09-11T08:18:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: osdmap e60: 8 total, 8 up, 8 in 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:06.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:06 smithi175 ceph-mon[32813]: Deploying daemon iscsi.iscsi.a on smithi175 2024-09-11T08:18:06.701 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.175", "placement": "1;smithi175=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: Saving service iscsi.datapool spec with placement smithi175=iscsi.a;count:1 2024-09-11T08:18:06.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: osdmap e60: 8 total, 8 up, 8 in 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-11T08:18:06.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-11T08:18:06.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:06.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[29664]: Deploying daemon iscsi.iscsi.a on smithi175 2024-09-11T08:18:06.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.175", "placement": "1;smithi175=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:06.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: Saving service iscsi.datapool spec with placement smithi175=iscsi.a;count:1 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1658090839' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: osdmap e60: 8 total, 8 up, 8 in 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:06.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-11T08:18:06.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-11T08:18:06.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:06.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:06 smithi173 ceph-mon[40835]: Deploying daemon iscsi.iscsi.a on smithi175 2024-09-11T08:18:07.708 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:07 smithi175 ceph-mon[32813]: pgmap v183: 132 pgs: 13 creating+peering, 18 unknown, 101 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 1.5 KiB/s wr, 32 op/s 2024-09-11T08:18:07.708 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:07 smithi175 ceph-mon[32813]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T08:18:07.708 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:07 smithi175 ceph-mon[32813]: Cluster is now healthy 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[29664]: pgmap v183: 132 pgs: 13 creating+peering, 18 unknown, 101 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 1.5 KiB/s wr, 32 op/s 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[29664]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[29664]: Cluster is now healthy 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[40835]: pgmap v183: 132 pgs: 13 creating+peering, 18 unknown, 101 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 1.5 KiB/s wr, 32 op/s 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[40835]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T08:18:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:07 smithi173 ceph-mon[40835]: Cluster is now healthy 2024-09-11T08:18:08.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:07 smithi175 systemd[1]: Starting Ceph iscsi.iscsi.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:18:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 -- 172.21.15.175:0/2941554750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc066c00 msgr2=0x7f5ccc0ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 --2- 172.21.15.175:0/2941554750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc066c00 0x7f5ccc0ff490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8004950 tx=0x7f5cc8009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 -- 172.21.15.175:0/2941554750 shutdown_connections 2024-09-11T08:18:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 --2- 172.21.15.175:0/2941554750 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc1024e0 0x7f5ccc104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 --2- 172.21.15.175:0/2941554750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 --2- 172.21.15.175:0/2941554750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc066c00 0x7f5ccc0ff490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.961+0000 7f5cd3785640 1 -- 172.21.15.175:0/2941554750 >> 172.21.15.175:0/2941554750 conn(0x7f5ccc0f6f40 msgr2=0x7f5ccc0f9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- 172.21.15.175:0/2941554750 shutdown_connections 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- 172.21.15.175:0/2941554750 wait complete. 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 Processor -- start 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- start start 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc066c00 0x7f5ccc10cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc1024e0 0x7f5ccc114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc114760 con 0x7f5ccc1024e0 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc1148d0 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd3785640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc114a90 con 0x7f5ccc066c00 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd0d20640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd0d20640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34690/0 (socket says 172.21.15.175:34690) 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd0d20640 1 -- 172.21.15.175:0/250975924 learned_addr learned my addr 172.21.15.175:0/250975924 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd1d22640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc1024e0 0x7f5ccc114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.962+0000 7f5cd1521640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc066c00 0x7f5ccc10cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 -- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc066c00 msgr2=0x7f5ccc10cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc066c00 0x7f5ccc10cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 -- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc1024e0 msgr2=0x7f5ccc114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc1024e0 0x7f5ccc114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 -- 172.21.15.175:0/250975924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc8005040 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd0d20640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c790 tx=0x7f5cbc007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:08.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00a640 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f5cbc00abe0 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc114d70 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc012a40 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.963+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc115230 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.964+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc04bf60 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.965+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f5cbc00a7a0 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.965+0000 7f5cc1ffb640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 0x7f5cb8071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.965+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f5cbc08e4b0 con 0x7f5ccc0ff9d0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.965+0000 7f5cd1521640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 0x7f5cb8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.966+0000 7f5cd1521640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 0x7f5cb8071300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009040 tx=0x7f5cc8035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:08.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:08.969+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5cbc0573a0 con 0x7f5ccc0ff9d0 2024-09-11T08:18:09.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.140+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ccc107600 con 0x7f5cb806ee50 2024-09-11T08:18:09.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.147+0000 7f5cc1ffb640 1 -- 172.21.15.175:0/250975924 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f5ccc107600 con 0x7f5cb806ee50 2024-09-11T08:18:09.148 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled prometheus update... 2024-09-11T08:18:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.149+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 msgr2=0x7f5cb8071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.149+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 0x7f5cb8071300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009040 tx=0x7f5cc8035040 comp rx=0 tx=0).stop 2024-09-11T08:18:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.149+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 msgr2=0x7f5ccc10d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.149+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c790 tx=0x7f5cbc007ec0 comp rx=0 tx=0).stop 2024-09-11T08:18:09.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 shutdown_connections 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ccc1024e0 0x7f5ccc114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ccc0ff9d0 0x7f5ccc10d180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f5cb806ee50 0x7f5cb8071300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 --2- 172.21.15.175:0/250975924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ccc066c00 0x7f5ccc10cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 >> 172.21.15.175:0/250975924 conn(0x7f5ccc0f6f40 msgr2=0x7f5ccc0fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 shutdown_connections 2024-09-11T08:18:09.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:09.150+0000 7f5cd3785640 1 -- 172.21.15.175:0/250975924 wait complete. 2024-09-11T08:18:09.578 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:09 smithi175 podman[61677]: 2024-09-11 08:18:09.040096712 +0000 UTC m=+0.020164273 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:18:09.578 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:09 smithi175 podman[61677]: 2024-09-11 08:18:09.174418104 +0000 UTC m=+0.154485664 container create fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:18:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:09 smithi175 ceph-mon[32813]: pgmap v184: 132 pgs: 5 creating+peering, 127 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 3.4 KiB/s wr, 106 op/s 2024-09-11T08:18:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:09 smithi175 ceph-mon[32813]: osdmap e61: 8 total, 8 up, 8 in 2024-09-11T08:18:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:09 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:09.913 DEBUG:teuthology.orchestra.run.smithi175:prometheus.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@prometheus.a.service 2024-09-11T08:18:09.965 INFO:tasks.cephadm:Adding node-exporter.a on smithi173 2024-09-11T08:18:09.965 INFO:tasks.cephadm:Adding node-exporter.b on smithi175 2024-09-11T08:18:09.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply node-exporter '2;smithi173=a;smithi175=b' 2024-09-11T08:18:10.151 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61677]: 2024-09-11 08:18:10.039304035 +0000 UTC m=+1.019371596 container init fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:18:10.152 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61677]: 2024-09-11 08:18:10.044643409 +0000 UTC m=+1.024710976 container start fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T08:18:10.152 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu[61728]: log file path now is '/var/log/tcmu-runner.log' 2024-09-11T08:18:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[29664]: pgmap v184: 132 pgs: 5 creating+peering, 127 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 3.4 KiB/s wr, 106 op/s 2024-09-11T08:18:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[29664]: osdmap e61: 8 total, 8 up, 8 in 2024-09-11T08:18:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[40835]: pgmap v184: 132 pgs: 5 creating+peering, 127 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 3.4 KiB/s wr, 106 op/s 2024-09-11T08:18:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[40835]: osdmap e61: 8 total, 8 up, 8 in 2024-09-11T08:18:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:09 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:10.455 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 bash[61677]: fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd 2024-09-11T08:18:10.455 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61842]: 2024-09-11 08:18:10.225570781 +0000 UTC m=+0.018373474 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:18:10.455 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61842]: 2024-09-11 08:18:10.323494953 +0000 UTC m=+0.116297634 container create aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T08:18:10.663 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-mon[32813]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-mon[32813]: Saving service prometheus spec with placement smithi175=a;count:1 2024-09-11T08:18:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:10.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61842]: 2024-09-11 08:18:10.576062328 +0000 UTC m=+0.368865008 container init aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T08:18:10.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 podman[61842]: 2024-09-11 08:18:10.580828038 +0000 UTC m=+0.373630719 container start aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:18:10.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 bash[61842]: aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d 2024-09-11T08:18:10.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 systemd[1]: Started Ceph iscsi.iscsi.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:18:11.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[29664]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:11.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[29664]: Saving service prometheus spec with placement smithi175=a;count:1 2024-09-11T08:18:11.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.119 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[40835]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:11.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[40835]: Saving service prometheus spec with placement smithi175=a;count:1 2024-09-11T08:18:11.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:10 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Started the configuration object watcher 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Checking for config object changes every 1s 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:10 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Processing osd blocklist entries for this node 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Reading the configuration object to update local LIO configuration 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Configuration does not have an entry for this host(smithi175.front.sepia.ceph.com) - nothing to define to LIO 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-11T08:18:11.165 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: * Environment: production 2024-09-11T08:18:11.550 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: Use a production WSGI server instead. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: * Debug mode: off 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug * Running on all addresses. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: * Running on all addresses. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug * Running on http://[fe80::ec4:7aff:fe88:71f1]:5000/ (Press CTRL+C to quit) 2024-09-11T08:18:11.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: * Running on http://[fe80::ec4:7aff:fe88:71f1]:5000/ (Press CTRL+C to quit) 2024-09-11T08:18:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: pgmap v186: 132 pgs: 132 active+clean; 581 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-09-11T08:18:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-11T08:18:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3151470232' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T08:18:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: pgmap v186: 132 pgs: 132 active+clean; 581 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3151470232' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: pgmap v186: 132 pgs: 132 active+clean; 581 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: Checking pool "datapool" exists for service iscsi.datapool 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3151470232' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.359+0000 7f8f0ca40640 1 -- 172.21.15.175:0/1402038558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fca50 msgr2=0x7f8f080fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.359+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/1402038558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fca50 0x7f8f080fcec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0004950 tx=0x7f8ef0009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- 172.21.15.175:0/1402038558 shutdown_connections 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/1402038558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fd400 0x7f8f08103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/1402038558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fca50 0x7f8f080fcec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/1402038558 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 0x7f8f080fbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- 172.21.15.175:0/1402038558 >> 172.21.15.175:0/1402038558 conn(0x7f8f080f6f40 msgr2=0x7f8f080f9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- 172.21.15.175:0/1402038558 shutdown_connections 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- 172.21.15.175:0/1402038558 wait complete. 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 Processor -- start 2024-09-11T08:18:12.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- start start 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 0x7f8f0810cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fca50 0x7f8f0810d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08114820 con 0x7f8f080fca50 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08114990 con 0x7f8f080fd400 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f0ca40640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08114b50 con 0x7f8f080fb780 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.360+0000 7f8f06d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34778/0 (socket says 172.21.15.175:34778) 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 -- 172.21.15.175:0/3846994831 learned_addr learned my addr 172.21.15.175:0/3846994831 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f05d9b640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fca50 0x7f8f0810d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f0659c640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 0x7f8f0810cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:12.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 -- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 msgr2=0x7f8f0810cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 0x7f8f0810cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 -- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fca50 msgr2=0x7f8f0810d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fca50 0x7f8f0810d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 -- 172.21.15.175:0/3846994831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0005040 con 0x7f8f080fd400 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f06d9d640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c960 tx=0x7f8f00007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00004020 con 0x7f8f080fd400 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f8f00004180 con 0x7f8f080fd400 2024-09-11T08:18:12.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f08114e30 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00003780 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.361+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08115220 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.362+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0804bf60 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.363+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f8f00003bb0 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.363+0000 7f8efeffd640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 0x7f8ef4071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.363+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f8f0008e9e0 con 0x7f8f080fd400 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.363+0000 7f8f0659c640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 0x7f8ef4071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.364+0000 7f8f0659c640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 0x7f8ef4071300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f080f83b0 tx=0x7f8ef8009120 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:12.642 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled node-exporter update... 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.367+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8f00057730 con 0x7f8f080fd400 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.543+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi173=a;smithi175=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f081076d0 con 0x7f8ef406ee50 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.548+0000 7f8efeffd640 1 -- 172.21.15.175:0/3846994831 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f8f081076d0 con 0x7f8ef406ee50 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 msgr2=0x7f8ef4071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 0x7f8ef4071300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f080f83b0 tx=0x7f8ef8009120 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 msgr2=0x7f8f08114250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c960 tx=0x7f8f00007ec0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 shutdown_connections 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f080fd400 0x7f8f08114250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f080fca50 0x7f8f0810d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f8ef406ee50 0x7f8ef4071300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 --2- 172.21.15.175:0/3846994831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f080fb780 0x7f8f0810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:12.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 >> 172.21.15.175:0/3846994831 conn(0x7f8f080f6f40 msgr2=0x7f8f080ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:12.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 shutdown_connections 2024-09-11T08:18:12.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:12.550+0000 7f8f0ca40640 1 -- 172.21.15.175:0/3846994831 wait complete. 2024-09-11T08:18:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:13 smithi175 ceph-mon[32813]: pgmap v187: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 59 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-11T08:18:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:13 smithi175 ceph-mon[32813]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi173=a;smithi175=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:13 smithi175 ceph-mon[32813]: Saving service node-exporter spec with placement smithi173=a;smithi175=b;count:2 2024-09-11T08:18:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:13 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:13.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:13 smithi175 ceph-mon[32813]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-11T08:18:13.652 DEBUG:teuthology.orchestra.run.smithi173:node-exporter.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.a.service 2024-09-11T08:18:13.655 DEBUG:teuthology.orchestra.run.smithi175:node-exporter.b> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.b.service 2024-09-11T08:18:13.658 INFO:tasks.cephadm:Adding alertmanager.a on smithi173 2024-09-11T08:18:13.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply alertmanager '1;smithi173=a' 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[29664]: pgmap v187: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 59 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[29664]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi173=a;smithi175=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[29664]: Saving service node-exporter spec with placement smithi173=a;smithi175=b;count:2 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[29664]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[40835]: pgmap v187: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 59 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-11T08:18:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[40835]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi173=a;smithi175=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[40835]: Saving service node-exporter spec with placement smithi173=a;smithi175=b;count:2 2024-09-11T08:18:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:13 smithi173 ceph-mon[40835]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-11T08:18:14.695 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: pgmap v188: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-11T08:18:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: Deploying daemon prometheus.a on smithi175 2024-09-11T08:18:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:15 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: pgmap v188: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: Deploying daemon prometheus.a on smithi175 2024-09-11T08:18:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: pgmap v188: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: Deploying daemon prometheus.a on smithi175 2024-09-11T08:18:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:15 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:16.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 -- 172.21.15.175:0/2808695256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358066c20 msgr2=0x7f53580fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 --2- 172.21.15.175:0/2808695256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358066c20 0x7f53580fd250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5354004950 tx=0x7f5354009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 -- 172.21.15.175:0/2808695256 shutdown_connections 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 --2- 172.21.15.175:0/2808695256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5358100340 0x7f53581007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 --2- 172.21.15.175:0/2808695256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53580fd790 0x7f53580ffc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 --2- 172.21.15.175:0/2808695256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358066c20 0x7f53580fd250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 -- 172.21.15.175:0/2808695256 >> 172.21.15.175:0/2808695256 conn(0x7f53580f6f10 msgr2=0x7f53580f9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 -- 172.21.15.175:0/2808695256 shutdown_connections 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.370+0000 7f53601f9640 1 -- 172.21.15.175:0/2808695256 wait complete. 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 Processor -- start 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 -- start start 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5358066c20 0x7f5358113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:16.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 0x7f5358113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535811ad70 con 0x7f53580fd790 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535811aee0 con 0x7f5358100340 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f53601f9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535811b0a0 con 0x7f5358066c20 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f535e796640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f535e796640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54328/0 (socket says 172.21.15.175:54328) 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f535d794640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 0x7f5358113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f535e796640 1 -- 172.21.15.175:0/3599823882 learned_addr learned my addr 172.21.15.175:0/3599823882 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.371+0000 7f535df95640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5358066c20 0x7f5358113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 -- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5358066c20 msgr2=0x7f5358113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5358066c20 0x7f5358113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 -- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 msgr2=0x7f5358113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 0x7f5358113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 -- 172.21.15.175:0/3599823882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354005040 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535d794640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 0x7f5358113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f535e796640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f535000db80 tx=0x7f5350004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350017070 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535811b380 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f535000f040 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500036a0 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.372+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535811b800 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.373+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535804bf60 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.374+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) v1 ==== 90832+0+0 (secure 0 0 0) 0x7f5350003a50 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.374+0000 7f534e7fc640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 0x7f5344071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.374+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f535008e820 con 0x7f5358100340 2024-09-11T08:18:16.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.374+0000 7f535df95640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 0x7f5344071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:16.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.375+0000 7f535df95640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 0x7f5344071390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5354004920 tx=0x7f5354035040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:16.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.379+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f53500573f0 con 0x7f5358100340 2024-09-11T08:18:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.546+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi173=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f535810dca0 con 0x7f534406eee0 2024-09-11T08:18:16.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.553+0000 7f534e7fc640 1 -- 172.21.15.175:0/3599823882 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f535810dca0 con 0x7f534406eee0 2024-09-11T08:18:16.554 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled alertmanager update... 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 msgr2=0x7f5344071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 0x7f5344071390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5354004920 tx=0x7f5354035040 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 msgr2=0x7f535811a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f535000db80 tx=0x7f5350004e60 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 shutdown_connections 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358100340 0x7f535811a7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53580fd790 0x7f5358113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f534406eee0 0x7f5344071390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 --2- 172.21.15.175:0/3599823882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5358066c20 0x7f5358113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 >> 172.21.15.175:0/3599823882 conn(0x7f53580f6f10 msgr2=0x7f53580fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 shutdown_connections 2024-09-11T08:18:16.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:16.556+0000 7f53601f9640 1 -- 172.21.15.175:0/3599823882 wait complete. 2024-09-11T08:18:17.617 DEBUG:teuthology.orchestra.run.smithi173:alertmanager.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@alertmanager.a.service 2024-09-11T08:18:17.620 INFO:tasks.cephadm:Adding grafana.a on smithi175 2024-09-11T08:18:17.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph orch apply grafana '1;smithi175=a' 2024-09-11T08:18:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:17 smithi175 ceph-mon[32813]: pgmap v189: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 41 KiB/s rd, 3.3 KiB/s wr, 101 op/s 2024-09-11T08:18:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:17 smithi175 ceph-mon[32813]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi173=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:17 smithi175 ceph-mon[32813]: Saving service alertmanager spec with placement smithi173=a;count:1 2024-09-11T08:18:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:17 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:17.890 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:17.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[29664]: pgmap v189: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 41 KiB/s rd, 3.3 KiB/s wr, 101 op/s 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[29664]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi173=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[29664]: Saving service alertmanager spec with placement smithi173=a;count:1 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[40835]: pgmap v189: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 41 KiB/s rd, 3.3 KiB/s wr, 101 op/s 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[40835]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi173=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[40835]: Saving service alertmanager spec with placement smithi173=a;count:1 2024-09-11T08:18:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:17 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:19.816 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:19 smithi175 ceph-mon[32813]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 51 op/s 2024-09-11T08:18:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:19 smithi173 ceph-mon[29664]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 51 op/s 2024-09-11T08:18:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:19 smithi173 ceph-mon[40835]: pgmap v190: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 51 op/s 2024-09-11T08:18:20.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 -- 172.21.15.175:0/4222060150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fb080 msgr2=0x7f6134104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:20.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 --2- 172.21.15.175:0/4222060150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fb080 0x7f6134104ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f612c009cd0 tx=0x7f612c004d10 comp rx=0 tx=0).stop 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 -- 172.21.15.175:0/4222060150 shutdown_connections 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 --2- 172.21.15.175:0/4222060150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fb080 0x7f6134104ec0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 --2- 172.21.15.175:0/4222060150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fe7f0 0x7f61340fa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 --2- 172.21.15.175:0/4222060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 0x7f61340fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 -- 172.21.15.175:0/4222060150 >> 172.21.15.175:0/4222060150 conn(0x7f61340f66a0 msgr2=0x7f61340f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 -- 172.21.15.175:0/4222060150 shutdown_connections 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.285+0000 7f613a507640 1 -- 172.21.15.175:0/4222060150 wait complete. 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 Processor -- start 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 -- start start 2024-09-11T08:18:20.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fb080 0x7f613410c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 0x7f613410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61341144d0 con 0x7f61340fdea0 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134114640 con 0x7f61340fe7f0 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f613a507640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6134114800 con 0x7f61340fb080 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54348/0 (socket says 172.21.15.175:54348) 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 -- 172.21.15.175:0/4177154256 learned_addr learned my addr 172.21.15.175:0/4177154256 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f612b7fe640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 0x7f613410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6133fff640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fb080 0x7f613410c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:20.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 -- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fb080 msgr2=0x7f613410c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fb080 0x7f613410c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 -- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 msgr2=0x7f613410cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 0x7f613410cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.286+0000 7f6138aa4640 1 -- 172.21.15.175:0/4177154256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0098b0 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f6138aa4640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f612c02a8d0 tx=0x7f612c004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c038070 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f612c03c410 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c007cd0 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6134114a80 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.287+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6134114f80 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.288+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613404bf60 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.288+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) v1 ==== 90832+0+0 (secure 0 0 0) 0x7f612c030070 con 0x7f61340fe7f0 2024-09-11T08:18:20.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.289+0000 7f61317fa640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 0x7f6120071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.289+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f612c0af4b0 con 0x7f61340fe7f0 2024-09-11T08:18:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.289+0000 7f6133fff640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 0x7f6120071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.289+0000 7f6133fff640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 0x7f6120071390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61240041d0 tx=0x7f6124009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.293+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f612c078160 con 0x7f61340fe7f0 2024-09-11T08:18:20.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.489+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 --> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f61341075a0 con 0x7f612006eee0 2024-09-11T08:18:20.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.496+0000 7f61317fa640 1 -- 172.21.15.175:0/4177154256 <== mgr.14150 v2:172.21.15.173:6800/3561883055 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f61341075a0 con 0x7f612006eee0 2024-09-11T08:18:20.497 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled grafana update... 2024-09-11T08:18:20.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.499+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 msgr2=0x7f6120071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:20.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.499+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 0x7f6120071390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61240041d0 tx=0x7f6124009040 comp rx=0 tx=0).stop 2024-09-11T08:18:20.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.499+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 msgr2=0x7f6134113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:20.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.499+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f612c02a8d0 tx=0x7f612c004d10 comp rx=0 tx=0).stop 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 shutdown_connections 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61340fe7f0 0x7f6134113f00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61340fdea0 0x7f613410cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f612006eee0 0x7f6120071390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 --2- 172.21.15.175:0/4177154256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61340fb080 0x7f613410c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 >> 172.21.15.175:0/4177154256 conn(0x7f61340f66a0 msgr2=0x7f61340f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 shutdown_connections 2024-09-11T08:18:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:20.500+0000 7f613a507640 1 -- 172.21.15.175:0/4177154256 wait complete. 2024-09-11T08:18:21.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:20 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:18:21.521 DEBUG:teuthology.orchestra.run.smithi175:grafana.a> sudo journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@grafana.a.service 2024-09-11T08:18:21.523 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T08:18:21.524 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T08:18:21.776 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[29664]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 44 op/s 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[29664]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[29664]: Saving service grafana spec with placement smithi175=a;count:1 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[40835]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 44 op/s 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[40835]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:21.838 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[40835]: Saving service grafana spec with placement smithi175=a;count:1 2024-09-11T08:18:21.839 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:21 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:21 smithi175 ceph-mon[32813]: pgmap v191: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 44 op/s 2024-09-11T08:18:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:21 smithi175 ceph-mon[32813]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi175=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T08:18:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:21 smithi175 ceph-mon[32813]: Saving service grafana spec with placement smithi175=a;count:1 2024-09-11T08:18:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:21 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:22 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:22 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:22 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- 172.21.15.173:0/1815558935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 msgr2=0x7f1bcc0fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1815558935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc0fdfa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc004890 tx=0x7f1bbc009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- 172.21.15.173:0/1815558935 shutdown_connections 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1815558935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1815558935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc0fdfa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1815558935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fc860 0x7f1bcc0fcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- 172.21.15.173:0/1815558935 >> 172.21.15.173:0/1815558935 conn(0x7f1bcc0f8020 msgr2=0x7f1bcc0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- 172.21.15.173:0/1815558935 shutdown_connections 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- 172.21.15.173:0/1815558935 wait complete. 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 Processor -- start 2024-09-11T08:18:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- start start 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fc860 0x7f1bcc10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc114660 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1147d0 con 0x7f1bcc0fc860 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.583+0000 7f1bd4229640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc114990 con 0x7f1bcc0fdb30 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd17c4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44136/0 (socket says 172.21.15.173:44136) 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 -- 172.21.15.173:0/1001311242 learned_addr learned my addr 172.21.15.173:0/1001311242 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd1fc5640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fc860 0x7f1bcc10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 -- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 msgr2=0x7f1bcc10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 -- 172.21.15.173:0/1001311242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fc860 msgr2=0x7f1bcc10cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fc860 0x7f1bcc10cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 -- 172.21.15.173:0/1001311242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8005040 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd17c4640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd27c6640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ece0 tx=0x7f1bc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400ee40 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f1bc400f040 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc005040 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4009340 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.584+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc115000 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.585+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc04bf60 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.586+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) v1 ==== 90832+0+0 (secure 0 0 0) 0x7f1bc4007890 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.586+0000 7f1bc27fc640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 0x7f1bb8071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.586+0000 7f1bd1fc5640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 0x7f1bb8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.586+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f1bc408edb0 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.587+0000 7f1bd1fc5640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 0x7f1bb8071390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8007fd0 tx=0x7f1bc800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:23.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.591+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1bc4057980 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:23 smithi173 ceph-mon[29664]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T08:18:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:23 smithi173 ceph-mon[40835]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T08:18:23.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.806+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1bcc1075c0 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.810+0000 7f1bc27fc640 1 -- 172.21.15.173:0/1001311242 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1bc405b190 con 0x7f1bcc0fe4e0 2024-09-11T08:18:23.811 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-09-11T08:18:23.811 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBPUuFmYzImMBAAy74dUllxhJVAmpxOAw2a4g== 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 msgr2=0x7f1bb8071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 0x7f1bb8071390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8007fd0 tx=0x7f1bc800b040 comp rx=0 tx=0).stop 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 msgr2=0x7f1bcc114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400ece0 tx=0x7f1bc400b040 comp rx=0 tx=0).stop 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 shutdown_connections 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bcc0fe4e0 0x7f1bcc114090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f1bb806eee0 0x7f1bb8071390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bcc0fdb30 0x7f1bcc10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 --2- 172.21.15.173:0/1001311242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bcc0fc860 0x7f1bcc10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 >> 172.21.15.173:0/1001311242 conn(0x7f1bcc0f8020 msgr2=0x7f1bcc0fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 shutdown_connections 2024-09-11T08:18:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:23.812+0000 7f1bd4229640 1 -- 172.21.15.173:0/1001311242 wait complete. 2024-09-11T08:18:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:23 smithi175 ceph-mon[32813]: pgmap v192: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T08:18:24.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:24.660 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:24.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:24.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:24.684 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:18:24.684 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T08:18:24.684 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T08:18:24.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T08:18:24.751 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:24.751 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1001311242' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:25.983 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:25 smithi175 ceph-mon[32813]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:26.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:25 smithi173 ceph-mon[29664]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:25 smithi173 ceph-mon[40835]: pgmap v193: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:26.644 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T08:18:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:27 smithi175 ceph-mon[32813]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:28.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:27 smithi173 ceph-mon[40835]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:28.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:27 smithi173 ceph-mon[29664]: pgmap v194: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T08:18:29.146 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:18:29.096Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-11T08:18:29.146 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:18:29 smithi175 bash[63649]: 2aa48f0ae77f9e0f4ab6aeacfcf7ef17d69db76d9194f062a91239ac18e226fd 2024-09-11T08:18:29.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- 172.21.15.175:0/2776659463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 msgr2=0x7f78840ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 --2- 172.21.15.175:0/2776659463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f78840ff4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7874009cd0 tx=0x7f7874004d10 comp rx=0 tx=0).stop 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- 172.21.15.175:0/2776659463 shutdown_connections 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 --2- 172.21.15.175:0/2776659463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 0x7f7884104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 --2- 172.21.15.175:0/2776659463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f7884101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 --2- 172.21.15.175:0/2776659463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f78840ff4c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- 172.21.15.175:0/2776659463 >> 172.21.15.175:0/2776659463 conn(0x7f78840f6ed0 msgr2=0x7f78840f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- 172.21.15.175:0/2776659463 shutdown_connections 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- 172.21.15.175:0/2776659463 wait complete. 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 Processor -- start 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.350+0000 7f7888dac640 1 -- start start 2024-09-11T08:18:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f788410d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 0x7f7884114370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884114940 con 0x7f78840ffa00 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884114ab0 con 0x7f7884065e70 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7884114c70 con 0x7f78841024a0 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32898/0 (socket says 172.21.15.175:32898) 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 -- 172.21.15.175:0/3170604327 learned_addr learned my addr 172.21.15.175:0/3170604327 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7881d9b640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f788410d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7882d9d640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 0x7f7884114370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 -- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 msgr2=0x7f7884114370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 0x7f7884114370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 -- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 msgr2=0x7f788410d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f788410d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 -- 172.21.15.175:0/3170604327 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740098b0 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7881d9b640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f788410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f788259c640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f787402afa0 tx=0x7f7874004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874038070 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7884114ef0 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f7874033ce0 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787403c9c0 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.351+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78841152d0 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.352+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788404bf60 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.353+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) v1 ==== 90832+0+0 (secure 0 0 0) 0x7f7874030070 con 0x7f7884065e70 2024-09-11T08:18:29.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.353+0000 7f7872ffd640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 0x7f786c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.353+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f78740af050 con 0x7f7884065e70 2024-09-11T08:18:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.353+0000 7f7881d9b640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 0x7f786c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.354+0000 7f7881d9b640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 0x7f786c071390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7878006fd0 tx=0x7f7878008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.357+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7874077d40 con 0x7f7884065e70 2024-09-11T08:18:29.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.568+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f788402aa40 con 0x7f7884065e70 2024-09-11T08:18:29.569 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:18:29 smithi175 systemd[1]: Started Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:18:29.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.574+0000 7f7872ffd640 1 -- 172.21.15.175:0/3170604327 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f787407b550 con 0x7f7884065e70 2024-09-11T08:18:29.574 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-09-11T08:18:29.575 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBVUuFmw9IEIhAAMJGwrkoIIbFg4phbhhNS5Q== 2024-09-11T08:18:29.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 msgr2=0x7f786c071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 0x7f786c071390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7878006fd0 tx=0x7f7878008040 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 msgr2=0x7f788410cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f787402afa0 tx=0x7f7874004d10 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 shutdown_connections 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f786c06eee0 0x7f786c071390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78841024a0 0x7f7884114370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78840ffa00 0x7f788410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 --2- 172.21.15.175:0/3170604327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7884065e70 0x7f788410cdd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 >> 172.21.15.175:0/3170604327 conn(0x7f78840f6ed0 msgr2=0x7f78840fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 shutdown_connections 2024-09-11T08:18:29.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T08:18:29.576+0000 7f7888dac640 1 -- 172.21.15.175:0/3170604327 wait complete. 2024-09-11T08:18:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: pgmap v195: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:18:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-11T08:18:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.175:0/3170604327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: pgmap v195: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.175:0/3170604327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: pgmap v195: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:18:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.175:0/3170604327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T08:18:30.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T08:18:30.535 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ignoring --setuser ceph since I am not root 2024-09-11T08:18:30.536 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ignoring --setgroup ceph since I am not root 2024-09-11T08:18:30.536 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-mgr[34895]: -- 172.21.15.175:0/91293065 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5560fbe44340 con 0x5560fbe50800 2024-09-11T08:18:30.536 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.357+0000 7fc2b177dec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:18:30.536 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.412+0000 7fc2b177dec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:18:30.610 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setuser ceph since I am not root 2024-09-11T08:18:30.610 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ignoring --setgroup ceph since I am not root 2024-09-11T08:18:30.610 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-mgr[29941]: -- 172.21.15.173:0/3153513419 <== mon.2 v2:172.21.15.173:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55da8422c340 con 0x55da84238c00 2024-09-11T08:18:30.611 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.370+0000 7f4d97b14ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T08:18:30.611 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.424+0000 7f4d97b14ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T08:18:30.611 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.488+0000 7f4d97b14ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:18:30.611 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.609+0000 7f4d97b14ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:18:30.844 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.477+0000 7fc2b177dec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T08:18:30.844 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.599+0000 7fc2b177dec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:18:30.844 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.735+0000 7fc2b177dec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:18:30.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.743+0000 7f4d97b14ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T08:18:31.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:30.990+0000 7fc2b177dec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:18:31.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:31.049+0000 7fc2b177dec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:18:31.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:31.208+0000 7fc2b177dec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:18:31.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:31 smithi175 ceph-mon[32813]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-11T08:18:31.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:31 smithi175 ceph-mon[32813]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-11T08:18:31.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-mon[40835]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-11T08:18:31.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-mon[40835]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-11T08:18:31.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-mon[29664]: from='mgr.14150 172.21.15.173:0/3085488990' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-11T08:18:31.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-mon[29664]: mgrmap e17: y(active, since 4m), standbys: x 2024-09-11T08:18:31.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:30.994+0000 7f4d97b14ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T08:18:31.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:31.053+0000 7f4d97b14ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T08:18:31.467 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:31 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:31.211+0000 7f4d97b14ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T08:18:31.802 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T08:18:31.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-11T08:18:31.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T08:18:31.883 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T08:18:31.883 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T08:18:31.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T08:18:32.140 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:32.217 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:32 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:32.053+0000 7f4d97b14ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:18:32.217 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:32 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:32.133+0000 7f4d97b14ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:18:32.594 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:32.100+0000 7fc2b177dec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T08:18:32.594 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:32.163+0000 7fc2b177dec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T08:18:32.873 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:32 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:32.872+0000 7f4d97b14ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:18:33.156 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:32.868+0000 7fc2b177dec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T08:18:33.157 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:32.978+0000 7fc2b177dec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:18:33.157 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.096+0000 7fc2b177dec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:18:33.164 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:32 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:32.985+0000 7f4d97b14ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T08:18:33.164 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.104+0000 7f4d97b14ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T08:18:33.164 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.163+0000 7f4d97b14ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:18:33.424 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.291+0000 7f4d97b14ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:18:33.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.362+0000 7f4d97b14ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:18:33.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.423+0000 7f4d97b14ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:18:33.536 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.154+0000 7fc2b177dec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T08:18:33.537 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.280+0000 7fc2b177dec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T08:18:33.537 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.345+0000 7fc2b177dec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T08:18:33.537 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.403+0000 7fc2b177dec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T08:18:33.537 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.535+0000 7fc2b177dec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:18:33.698 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.558+0000 7f4d97b14ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T08:18:33.698 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.629+0000 7f4d97b14ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:18:33.698 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.697+0000 7f4d97b14ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:18:33.801 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.598+0000 7fc2b177dec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T08:18:33.802 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.661+0000 7fc2b177dec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T08:18:33.802 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.742+0000 7fc2b177dec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:18:33.802 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.799+0000 7fc2b177dec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:18:33.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 -- 172.21.15.173:0/3601536764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fb800 msgr2=0x7f81e40fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3601536764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fb800 0x7f81e40fbc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f81d4004980 tx=0x7f81d4009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 -- 172.21.15.173:0/3601536764 shutdown_connections 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3601536764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fc1b0 0x7f81e4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3601536764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fb800 0x7f81e40fbc70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3601536764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 -- 172.21.15.173:0/3601536764 >> 172.21.15.173:0/3601536764 conn(0x7f81e4071c00 msgr2=0x7f81e4072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:33.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 -- 172.21.15.173:0/3601536764 shutdown_connections 2024-09-11T08:18:33.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 -- 172.21.15.173:0/3601536764 wait complete. 2024-09-11T08:18:33.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.883+0000 7f81e9eea640 1 Processor -- start 2024-09-11T08:18:33.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 -- start start 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fc1b0 0x7f81e410e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4119020 con 0x7f81e40fb800 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4119190 con 0x7f81e41017d0 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e9eea640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4119350 con 0x7f81e40fc1b0 2024-09-11T08:18:33.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48896/0 (socket says 172.21.15.173:48896) 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.173:44368/0 (socket says 172.21.15.173:44368) 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 -- 172.21.15.173:0/3634962643 learned_addr learned my addr 172.21.15.173:0/3634962643 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e2ffd640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fc1b0 0x7f81e410e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fc1b0 msgr2=0x7f81e410e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fc1b0 0x7f81e410e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 msgr2=0x7f81e410e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e37fe640 1 -- 172.21.15.173:0/3634962643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0098b0 con 0x7f81e40fb800 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.884+0000 7f81e3fff640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:33.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81e37fe640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00ebf0 tx=0x7f81cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc007c30 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f81cc00f040 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc009340 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.885+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4119910 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.886+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e40fcef0 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.886+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) v1 ==== 90846+0+0 (secure 0 0 0) 0x7f81cc009730 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.887+0000 7f81dbfff640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 0x7f81d00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.887+0000 7f81e2ffd640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 msgr2=0x7f81d00713b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/3561883055 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.887+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7144+0+0 (secure 0 0 0) 0x7f81cc08e7c0 con 0x7f81e40fb800 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.887+0000 7f81e2ffd640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 0x7f81d00713b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T08:18:33.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:33.891+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f81cc057290 con 0x7f81e40fb800 2024-09-11T08:18:33.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.778+0000 7f4d97b14ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T08:18:33.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.838+0000 7f4d97b14ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T08:18:33.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:33.905+0000 7f4d97b14ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:18:34.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.088+0000 7f81e2ffd640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 msgr2=0x7f81d00713b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.173:6800/3561883055 2024-09-11T08:18:34.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.088+0000 7f81e2ffd640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 0x7f81d00713b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T08:18:34.094 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:33.856+0000 7fc2b177dec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T08:18:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.118+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f81e410aa40 con 0x7f81e40fb800 2024-09-11T08:18:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.122+0000 7f81dbfff640 1 -- 172.21.15.173:0/3634962643 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+176737 (secure 0 0 0) 0x7f81cc05aaa0 con 0x7f81e40fb800 2024-09-11T08:18:34.125 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:18:34.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 msgr2=0x7f81d00713b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T08:18:34.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 0x7f81d00713b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 msgr2=0x7f81e410ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00ebf0 tx=0x7f81cc00b040 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 shutdown_connections 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e41017d0 0x7f81e410e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:6800/3561883055,v1:172.21.15.173:6801/3561883055] conn(0x7f81d006ef00 0x7f81d00713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81e40fc1b0 0x7f81e410e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 --2- 172.21.15.173:0/3634962643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e40fb800 0x7f81e410ddf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.124+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 >> 172.21.15.173:0/3634962643 conn(0x7f81e4071c00 msgr2=0x7f81e40fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.125+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 shutdown_connections 2024-09-11T08:18:34.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:34.125+0000 7f81e9eea640 1 -- 172.21.15.173:0/3634962643 wait complete. 2024-09-11T08:18:34.432 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3634962643' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T08:18:34.433 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3634962643' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T08:18:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3634962643' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T08:18:34.878 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3561883055},{"type":"v1","addr":"172.21.15.173:6801","nonce":3561883055}]},"active_addr":"172.21.15.173:6801/3561883055","active_change":"2024-09-11T08:13:40.232256+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":24106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.173:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"cephadm","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3160318690}]},{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":595685364}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2383839214}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":955292174}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3093200474}]}]} 2024-09-11T08:18:34.882 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T08:18:34.882 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T08:18:34.882 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:34.599+0000 7fc2b177dec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: [11/Sep/2024:08:18:34] ENGINE Bus STARTING 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: CherryPy Checker: 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: The Application mounted at '' has an empty config. 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: [11/Sep/2024:08:18:34] ENGINE Serving on http://:::9283 2024-09-11T08:18:34.883 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: [11/Sep/2024:08:18:34] ENGINE Bus STARTED 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:34.683+0000 7f4d97b14ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:18:34] ENGINE Bus STARTING 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: CherryPy Checker: 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: The Application mounted at '' has an empty config. 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:18:34] ENGINE Serving on http://:::9283 2024-09-11T08:18:34.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:34 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:18:34] ENGINE Bus STARTED 2024-09-11T08:18:35.139 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:35.177 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:18:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:18:35.343 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: Standby manager daemon x restarted 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: Standby manager daemon x started 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: Active manager daemon y restarted 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: Activating manager daemon y 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: osdmap e62: 8 total, 8 up, 8 in 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: mgrmap e18: y(active, starting, since 0.0083522s), standbys: x 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:18:35.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:18:35.345 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: Manager daemon y is now available 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: Standby manager daemon x restarted 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: Standby manager daemon x started 2024-09-11T08:18:35.346 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: Active manager daemon y restarted 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: Activating manager daemon y 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: osdmap e62: 8 total, 8 up, 8 in 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: mgrmap e18: y(active, starting, since 0.0083522s), standbys: x 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:18:35.347 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: Manager daemon y is now available 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:35.348 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:35.349 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:18:35.349 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: Standby manager daemon x restarted 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: Standby manager daemon x started 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.? 172.21.15.175:0/2609241172' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: Active manager daemon y restarted 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: Activating manager daemon y 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: osdmap e62: 8 total, 8 up, 8 in 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: mgrmap e18: y(active, starting, since 0.0083522s), standbys: x 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T08:18:35.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T08:18:35.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: Manager daemon y is now available 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-11T08:18:35.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-11T08:18:36.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:18:36.668 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:36.399+0000 7f4d3a896640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:08:18:36] ENGINE Error in HTTPServer.serve 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: Traceback (most recent call last): 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._connections.run(self.expiration_interval) 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._run(expiration_interval) 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:18:36.669 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: s = self.context.wrap_socket( 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: return self.sslsocket_class._create( 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self.do_handshake() 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: self._sslobj.do_handshake() 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:18:36.670 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[29664]: mgrmap e19: y(active, since 1.01191s), standbys: x 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[29664]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[40835]: mgrmap e19: y(active, since 1.01191s), standbys: x 2024-09-11T08:18:36.963 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:36.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[40835]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:36.964 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:36 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 -- 172.21.15.173:0/3942919264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec101b70 msgr2=0x7f6bec0664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3942919264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec101b70 0x7f6bec0664c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc004950 tx=0x7f6bdc009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 -- 172.21.15.173:0/3942919264 shutdown_connections 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3942919264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec0ff250 0x7f6bec0ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3942919264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec101b70 0x7f6bec0664c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3942919264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101710 0x7f6bec065f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.039+0000 7f6bf400b640 1 -- 172.21.15.173:0/3942919264 >> 172.21.15.173:0/3942919264 conn(0x7f6bec072510 msgr2=0x7f6bec072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- 172.21.15.173:0/3942919264 shutdown_connections 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- 172.21.15.173:0/3942919264 wait complete. 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 Processor -- start 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- start start 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101b70 0x7f6bec1134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec113af0 con 0x7f6bec0ff250 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec113c60 con 0x7f6bec101b70 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf400b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec113e20 con 0x7f6bec101710 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf1da7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf15a6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf1da7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48988/0 (socket says 172.21.15.173:48988) 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf1da7640 1 -- 172.21.15.173:0/3906016572 learned_addr learned my addr 172.21.15.173:0/3906016572 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.040+0000 7f6bf15a6640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:55836/0 (socket says 172.21.15.173:55836) 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf25a8640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101b70 0x7f6bec1134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 -- 172.21.15.173:0/3906016572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101b70 msgr2=0x7f6bec1134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101b70 0x7f6bec1134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 -- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 msgr2=0x7f6bec119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 -- 172.21.15.173:0/3906016572 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40098b0 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf1da7640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf15a6640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc02a4a0 tx=0x7f6bdc035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0090d0 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc005040 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f6bdc009230 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc03c410 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.041+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec120160 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.042+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec0fbdc0 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.042+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 19) v1 ==== 90589+0+0 (secure 0 0 0) 0x7f6bdc030020 con 0x7f6bec101710 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.043+0000 7f6be27fc640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 0x7f6bd80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.043+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f6bdc0ae210 con 0x7f6bec101710 2024-09-11T08:18:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.043+0000 7f6bf1da7640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 0x7f6bd80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.043+0000 7f6bf1da7640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 0x7f6bd80710c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6be800f410 tx=0x7f6be8009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.047+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6bdc0778a0 con 0x7f6bec101710 2024-09-11T08:18:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:36 smithi175 ceph-mon[32813]: mgrmap e19: y(active, since 1.01191s), standbys: x 2024-09-11T08:18:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:36 smithi175 ceph-mon[32813]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:36 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:37.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.206+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bec113f60 con 0x7f6bec101710 2024-09-11T08:18:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.207+0000 7f6be27fc640 1 -- 172.21.15.173:0/3906016572 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+21413 (secure 0 0 0) 0x7f6bdc07a920 con 0x7f6bec101710 2024-09-11T08:18:37.208 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:18:37.212 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":62,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","created":"2024-09-11T08:12:48.743200+0000","modified":"2024-09-11T08:18:34.685515+0000","last_up_change":"2024-09-11T08:17:45.517195+0000","last_in_change":"2024-09-11T08:17:28.274408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T08:15:48.540348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-11T08:17:56.686336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"datapool","create_time":"2024-09-11T08:17:56.920434+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":57,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-11T08:17:58.633611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-11T08:18:00.619271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-11T08:18:02.690398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"1ab3b916-d9b5-4d36-b89e-555941b2ef9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6803","nonce":3725419528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6805","nonce":3725419528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6809","nonce":3725419528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6807","nonce":3725419528}]},"public_addr":"172.21.15.173:6803/3725419528","cluster_addr":"172.21.15.173:6805/3725419528","heartbeat_back_addr":"172.21.15.173:6809/3725419528","heartbeat_front_addr":"172.21.15.173:6807/3725419528","state":["exists","up"]},{"osd":1,"uuid":"8052c26f-b90b-4c4a-a1ef-02090406b450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6811","nonce":2339789859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6813","nonce":2339789859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6817","nonce":2339789859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6815","nonce":2339789859}]},"public_addr":"172.21.15.173:6811/2339789859","cluster_addr":"172.21.15.173:6813/2339789859","heartbeat_back_addr":"172.21.15.173:6817/2339789859","heartbeat_front_addr":"172.21.15.173:6815/2339789859","state":["exists","up"]},{"osd":2,"uuid":"c2086bc5-1352-4a1a-84fd-46bfb860441a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6819","nonce":151053591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6821","nonce":151053591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6825","nonce":151053591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6823","nonce":151053591}]},"public_addr":"172.21.15.173:6819/151053591","cluster_addr":"172.21.15.173:6821/151053591","heartbeat_back_addr":"172.21.15.173:6825/151053591","heartbeat_front_addr":"172.21.15.173:6823/151053591","state":["exists","up"]},{"osd":3,"uuid":"08e67f5c-571e-4e76-b3c3-e47e87fd436a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6827","nonce":643295685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6829","nonce":643295685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6833","nonce":643295685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6831","nonce":643295685}]},"public_addr":"172.21.15.173:6827/643295685","cluster_addr":"172.21.15.173:6829/643295685","heartbeat_back_addr":"172.21.15.173:6833/643295685","heartbeat_front_addr":"172.21.15.173:6831/643295685","state":["exists","up"]},{"osd":4,"uuid":"6730fe3b-6d6e-4091-9eed-11e18864e1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6801","nonce":1661927425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6803","nonce":1661927425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6807","nonce":1661927425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6805","nonce":1661927425}]},"public_addr":"172.21.15.175:6801/1661927425","cluster_addr":"172.21.15.175:6803/1661927425","heartbeat_back_addr":"172.21.15.175:6807/1661927425","heartbeat_front_addr":"172.21.15.175:6805/1661927425","state":["exists","up"]},{"osd":5,"uuid":"b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6809","nonce":3173894990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6811","nonce":3173894990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6815","nonce":3173894990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6813","nonce":3173894990}]},"public_addr":"172.21.15.175:6809/3173894990","cluster_addr":"172.21.15.175:6811/3173894990","heartbeat_back_addr":"172.21.15.175:6815/3173894990","heartbeat_front_addr":"172.21.15.175:6813/3173894990","state":["exists","up"]},{"osd":6,"uuid":"ac346016-6c9b-45fa-8849-7b87caf51a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6817","nonce":2487468341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6819","nonce":2487468341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6823","nonce":2487468341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6821","nonce":2487468341}]},"public_addr":"172.21.15.175:6817/2487468341","cluster_addr":"172.21.15.175:6819/2487468341","heartbeat_back_addr":"172.21.15.175:6823/2487468341","heartbeat_front_addr":"172.21.15.175:6821/2487468341","state":["exists","up"]},{"osd":7,"uuid":"b40563d9-8160-4517-a983-129d55cf216a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6825","nonce":3505122552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6827","nonce":3505122552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6831","nonce":3505122552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6829","nonce":3505122552}]},"public_addr":"172.21.15.175:6825/3505122552","cluster_addr":"172.21.15.175:6827/3505122552","heartbeat_back_addr":"172.21.15.175:6831/3505122552","heartbeat_front_addr":"172.21.15.175:6829/3505122552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:14:58.838772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:22.257022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:45.382906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:09.808893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:31.379056+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:54.710183+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:19.124216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:43.574635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:0/595685364":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/2383839214":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6801/3561883055":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6800/2991830914":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6800/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/932764076":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/60027638":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/3081945920":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/3160318690":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/896925606":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/2233640548":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/1191247772":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6801/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/3093200474":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/955292174":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6801/2991830914":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6800/3561883055":"2024-09-12T08:18:34.685470+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 msgr2=0x7f6bd80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 0x7f6bd80710c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6be800f410 tx=0x7f6be8009040 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 msgr2=0x7f6bec119850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc02a4a0 tx=0x7f6bdc035040 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 shutdown_connections 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f6bd806ec10 0x7f6bd80710c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bec101b70 0x7f6bec1134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bec101710 0x7f6bec119850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 --2- 172.21.15.173:0/3906016572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bec0ff250 0x7f6bec119310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 >> 172.21.15.173:0/3906016572 conn(0x7f6bec072510 msgr2=0x7f6bec0fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 shutdown_connections 2024-09-11T08:18:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:37.210+0000 7f6bf400b640 1 -- 172.21.15.173:0/3906016572 wait complete. 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: [11/Sep/2024:08:18:36] ENGINE Bus STARTING 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: [11/Sep/2024:08:18:36] ENGINE Serving on https://172.21.15.173:7150 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: [11/Sep/2024:08:18:36] ENGINE Bus STARTED 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: [11/Sep/2024:08:18:36] ENGINE Error in HTTPServer.serve 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: Traceback (most recent call last): 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._run(expiration_interval) 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:18:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: s = self.context.wrap_socket( 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: return self.sslsocket_class._create( 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: self.do_handshake() 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: self._sslobj.do_handshake() 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3906016572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[29664]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-11T08:18:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: [11/Sep/2024:08:18:36] ENGINE Bus STARTING 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: [11/Sep/2024:08:18:36] ENGINE Serving on https://172.21.15.173:7150 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: [11/Sep/2024:08:18:36] ENGINE Bus STARTED 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: [11/Sep/2024:08:18:36] ENGINE Error in HTTPServer.serve 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: Traceback (most recent call last): 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._run(expiration_interval) 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:18:37.969 INFO:journalctl@ceph.mon.c.smithi173.stdout: s = self.context.wrap_socket( 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: return self.sslsocket_class._create( 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: self.do_handshake() 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._sslobj.do_handshake() 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3906016572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:37.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:37 smithi173 ceph-mon[40835]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-11T08:18:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: [11/Sep/2024:08:18:36] ENGINE Bus STARTING 2024-09-11T08:18:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: [11/Sep/2024:08:18:36] ENGINE Serving on https://172.21.15.173:7150 2024-09-11T08:18:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: [11/Sep/2024:08:18:36] ENGINE Bus STARTED 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: [11/Sep/2024:08:18:36] ENGINE Error in HTTPServer.serve 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: Traceback (most recent call last): 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: self._connections.run(self.expiration_interval) 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: self._run(expiration_interval) 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: s = self.context.wrap_socket( 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: return self.sslsocket_class._create( 2024-09-11T08:18:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout: self.do_handshake() 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout: self._sslobj.do_handshake() 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3906016572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:38.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:37 smithi175 ceph-mon[32813]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-11T08:18:38.601 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T08:18:38.602 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T08:18:38.877 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.170 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.171 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:38 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:39.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:38 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 3760M 2024-09-11T08:18:40.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:40.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 3760M 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.122 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.123 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:40.123 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:39 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 3760M 2024-09-11T08:18:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:18:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:18:40.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:39 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 -- 172.21.15.173:0/337076743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 msgr2=0x7f8b380fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 --2- 172.21.15.173:0/337076743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b380fdcf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8b28004950 tx=0x7f8b28009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 -- 172.21.15.173:0/337076743 shutdown_connections 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 --2- 172.21.15.173:0/337076743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 0x7f8b381092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 --2- 172.21.15.173:0/337076743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 0x7f8b38106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 --2- 172.21.15.173:0/337076743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b380fdcf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 -- 172.21.15.173:0/337076743 >> 172.21.15.173:0/337076743 conn(0x7f8b38071c00 msgr2=0x7f8b38072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 -- 172.21.15.173:0/337076743 shutdown_connections 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 -- 172.21.15.173:0/337076743 wait complete. 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.758+0000 7f8b3f349640 1 Processor -- start 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 -- start start 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 0x7f8b381131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 0x7f8b3810cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3810d440 con 0x7f8b380fd920 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3810d5b0 con 0x7f8b38106ed0 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3f349640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3810d770 con 0x7f8b380fe230 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49008/0 (socket says 172.21.15.173:49008) 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 -- 172.21.15.173:0/3719766908 learned_addr learned my addr 172.21.15.173:0/3719766908 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3c8e4640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 0x7f8b381131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d8e6640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 0x7f8b3810cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 -- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 msgr2=0x7f8b381131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 0x7f8b381131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 -- 172.21.15.173:0/3719766908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 msgr2=0x7f8b3810cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 0x7f8b3810cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 -- 172.21.15.173:0/3719766908 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34005040 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.759+0000 7f8b3d0e5640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009040 tx=0x7f8b28035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.760+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280090d0 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.760+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f8b28009230 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.760+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28033dd0 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.760+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b28005040 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.760+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b38119ab0 con 0x7f8b380fd920 2024-09-11T08:18:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.761+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b38065a20 con 0x7f8b380fd920 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.762+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f8b28030020 con 0x7f8b380fd920 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.762+0000 7f8b2dffb640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 0x7f8b240713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.762+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f8b280ae490 con 0x7f8b380fd920 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.762+0000 7f8b3c8e4640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 0x7f8b240713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.763+0000 7f8b3c8e4640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 0x7f8b240713c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b3810e520 tx=0x7f8b3400b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.769+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8b2807b0e0 con 0x7f8b380fd920 2024-09-11T08:18:40.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.953+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b3810bb80 con 0x7f8b380fd920 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 3760M 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.955 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 3760M 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:40 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:40.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.955+0000 7f8b2dffb640 1 -- 172.21.15.173:0/3719766908 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+21413 (secure 0 0 0) 0x7f8b2807aa80 con 0x7f8b380fd920 2024-09-11T08:18:40.957 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:18:40.958 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":62,"fsid":"4492cbfa-7015-11ef-bcea-c7b262605968","created":"2024-09-11T08:12:48.743200+0000","modified":"2024-09-11T08:18:34.685515+0000","last_up_change":"2024-09-11T08:17:45.517195+0000","last_in_change":"2024-09-11T08:17:28.274408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T08:15:48.540348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-11T08:17:56.686336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"datapool","create_time":"2024-09-11T08:17:56.920434+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":57,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-09-11T08:17:58.633611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-11T08:18:00.619271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-11T08:18:02.690398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"1ab3b916-d9b5-4d36-b89e-555941b2ef9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6803","nonce":3725419528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6805","nonce":3725419528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6809","nonce":3725419528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3725419528},{"type":"v1","addr":"172.21.15.173:6807","nonce":3725419528}]},"public_addr":"172.21.15.173:6803/3725419528","cluster_addr":"172.21.15.173:6805/3725419528","heartbeat_back_addr":"172.21.15.173:6809/3725419528","heartbeat_front_addr":"172.21.15.173:6807/3725419528","state":["exists","up"]},{"osd":1,"uuid":"8052c26f-b90b-4c4a-a1ef-02090406b450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6811","nonce":2339789859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6813","nonce":2339789859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6817","nonce":2339789859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2339789859},{"type":"v1","addr":"172.21.15.173:6815","nonce":2339789859}]},"public_addr":"172.21.15.173:6811/2339789859","cluster_addr":"172.21.15.173:6813/2339789859","heartbeat_back_addr":"172.21.15.173:6817/2339789859","heartbeat_front_addr":"172.21.15.173:6815/2339789859","state":["exists","up"]},{"osd":2,"uuid":"c2086bc5-1352-4a1a-84fd-46bfb860441a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6819","nonce":151053591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6821","nonce":151053591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6825","nonce":151053591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":151053591},{"type":"v1","addr":"172.21.15.173:6823","nonce":151053591}]},"public_addr":"172.21.15.173:6819/151053591","cluster_addr":"172.21.15.173:6821/151053591","heartbeat_back_addr":"172.21.15.173:6825/151053591","heartbeat_front_addr":"172.21.15.173:6823/151053591","state":["exists","up"]},{"osd":3,"uuid":"08e67f5c-571e-4e76-b3c3-e47e87fd436a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6827","nonce":643295685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6829","nonce":643295685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6833","nonce":643295685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":643295685},{"type":"v1","addr":"172.21.15.173:6831","nonce":643295685}]},"public_addr":"172.21.15.173:6827/643295685","cluster_addr":"172.21.15.173:6829/643295685","heartbeat_back_addr":"172.21.15.173:6833/643295685","heartbeat_front_addr":"172.21.15.173:6831/643295685","state":["exists","up"]},{"osd":4,"uuid":"6730fe3b-6d6e-4091-9eed-11e18864e1ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6801","nonce":1661927425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6803","nonce":1661927425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6807","nonce":1661927425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1661927425},{"type":"v1","addr":"172.21.15.175:6805","nonce":1661927425}]},"public_addr":"172.21.15.175:6801/1661927425","cluster_addr":"172.21.15.175:6803/1661927425","heartbeat_back_addr":"172.21.15.175:6807/1661927425","heartbeat_front_addr":"172.21.15.175:6805/1661927425","state":["exists","up"]},{"osd":5,"uuid":"b1196f9e-bdbf-4b82-903e-bdc1c9fb45e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6809","nonce":3173894990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6811","nonce":3173894990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6815","nonce":3173894990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3173894990},{"type":"v1","addr":"172.21.15.175:6813","nonce":3173894990}]},"public_addr":"172.21.15.175:6809/3173894990","cluster_addr":"172.21.15.175:6811/3173894990","heartbeat_back_addr":"172.21.15.175:6815/3173894990","heartbeat_front_addr":"172.21.15.175:6813/3173894990","state":["exists","up"]},{"osd":6,"uuid":"ac346016-6c9b-45fa-8849-7b87caf51a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6817","nonce":2487468341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6819","nonce":2487468341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6823","nonce":2487468341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2487468341},{"type":"v1","addr":"172.21.15.175:6821","nonce":2487468341}]},"public_addr":"172.21.15.175:6817/2487468341","cluster_addr":"172.21.15.175:6819/2487468341","heartbeat_back_addr":"172.21.15.175:6823/2487468341","heartbeat_front_addr":"172.21.15.175:6821/2487468341","state":["exists","up"]},{"osd":7,"uuid":"b40563d9-8160-4517-a983-129d55cf216a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6825","nonce":3505122552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6827","nonce":3505122552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6831","nonce":3505122552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3505122552},{"type":"v1","addr":"172.21.15.175:6829","nonce":3505122552}]},"public_addr":"172.21.15.175:6825/3505122552","cluster_addr":"172.21.15.175:6827/3505122552","heartbeat_back_addr":"172.21.15.175:6831/3505122552","heartbeat_front_addr":"172.21.15.175:6829/3505122552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:14:58.838772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:22.257022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:15:45.382906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:09.808893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:31.379056+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:16:54.710183+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:19.124216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T08:17:43.574635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:0/595685364":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/2383839214":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6801/3561883055":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6800/2991830914":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6800/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/932764076":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/60027638":"2024-09-12T08:13:16.827305+0000","172.21.15.173:0/3081945920":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/3160318690":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/896925606":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/2233640548":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/1191247772":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6801/542277039":"2024-09-12T08:13:40.232153+0000","172.21.15.173:0/3093200474":"2024-09-12T08:18:34.685470+0000","172.21.15.173:0/955292174":"2024-09-12T08:18:34.685470+0000","172.21.15.173:6801/2991830914":"2024-09-12T08:13:16.827305+0000","172.21.15.173:6800/3561883055":"2024-09-12T08:18:34.685470+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T08:18:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 msgr2=0x7f8b240713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 0x7f8b240713c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b3810e520 tx=0x7f8b3400b040 comp rx=0 tx=0).stop 2024-09-11T08:18:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 msgr2=0x7f8b38112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009040 tx=0x7f8b28035040 comp rx=0 tx=0).stop 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 shutdown_connections 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f8b2406ef10 0x7f8b240713c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b38106ed0 0x7f8b3810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b380fe230 0x7f8b381131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 --2- 172.21.15.173:0/3719766908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b380fd920 0x7f8b38112c60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 >> 172.21.15.173:0/3719766908 conn(0x7f8b38071c00 msgr2=0x7f8b38108820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 shutdown_connections 2024-09-11T08:18:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:40.957+0000 7f8b3f349640 1 -- 172.21.15.173:0/3719766908 wait complete. 2024-09-11T08:18:41.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 3760M 2024-09-11T08:18:41.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:41.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:40 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:18:41.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T08:18:41.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T08:18:41.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T08:18:41.876 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T08:18:41.877 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T08:18:41.877 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T08:18:41.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T08:18:41.879 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[40835]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[40835]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[40835]: Deploying daemon alertmanager.a on smithi173 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[40835]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3719766908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[29664]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[29664]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[29664]: Deploying daemon alertmanager.a on smithi173 2024-09-11T08:18:42.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[29664]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-09-11T08:18:42.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3719766908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:42.319 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:42.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:41 smithi175 ceph-mon[32813]: Updating smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:41 smithi175 ceph-mon[32813]: Updating smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T08:18:42.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:41 smithi175 ceph-mon[32813]: Deploying daemon alertmanager.a on smithi173 2024-09-11T08:18:42.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:41 smithi175 ceph-mon[32813]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-09-11T08:18:42.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3719766908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T08:18:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:42.437 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:44.184 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:43 smithi173 ceph-mon[29664]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-11T08:18:44.184 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:43 smithi173 ceph-mon[40835]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-11T08:18:44.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:43 smithi175 ceph-mon[32813]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-11T08:18:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:18:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:18:45.867 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:45.868 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:18:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:45 smithi175 ceph-mon[32813]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T08:18:46.095 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:18:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:45 smithi173 ceph-mon[29664]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T08:18:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:45 smithi173 ceph-mon[40835]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T08:18:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:48.197 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:47 smithi173 ceph-mon[29664]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:48.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:47 smithi173 ceph-mon[40835]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:48.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:47 smithi175 ceph-mon[32813]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:49 smithi173 ceph-mon[29664]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:49 smithi173 ceph-mon[40835]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:49 smithi175 ceph-mon[32813]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:18:51.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- 172.21.15.173:0/313769684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37080fd400 msgr2=0x7f3708109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 --2- 172.21.15.173:0/313769684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37080fd400 0x7f3708109690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3700009d00 tx=0x7f3700004d10 comp rx=0 tx=0).stop 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- 172.21.15.173:0/313769684 shutdown_connections 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 --2- 172.21.15.173:0/313769684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37080fd400 0x7f3708109690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 --2- 172.21.15.173:0/313769684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fca50 0x7f37080fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 --2- 172.21.15.173:0/313769684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37081028e0 0x7f3708102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- 172.21.15.173:0/313769684 >> 172.21.15.173:0/313769684 conn(0x7f3708073600 msgr2=0x7f3708073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- 172.21.15.173:0/313769684 shutdown_connections 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- 172.21.15.173:0/313769684 wait complete. 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 Processor -- start 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.593+0000 7f370f6a1640 1 -- start start 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080fca50 0x7f3708112950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 0x7f3708112e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37081028e0 0x7f370810cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370810d0f0 con 0x7f37080fd400 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370810d260 con 0x7f37080fca50 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370810d420 con 0x7f37081028e0 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 0x7f3708112e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 0x7f3708112e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34356/0 (socket says 172.21.15.173:34356) 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370dc3e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37081028e0 0x7f370810cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 -- 172.21.15.173:0/1278567208 learned_addr learned my addr 172.21.15.173:0/1278567208 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370d43d640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080fca50 0x7f3708112950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 -- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37081028e0 msgr2=0x7f370810cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37081028e0 0x7f370810cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 -- 172.21.15.173:0/1278567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080fca50 msgr2=0x7f3708112950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080fca50 0x7f3708112950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8005040 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370cc3c640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 0x7f3708112e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009780 tx=0x7f36f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80099c0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000098b0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f36f800f040 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.594+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8013bf0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.595+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37081197e0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.595+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37080fbca0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.596+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f36f800ebb0 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.596+0000 7f36fdffb640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f36f406ef10 0x7f36f40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.596+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f36f808e940 con 0x7f37080fd400 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.596+0000 7f370d43d640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f36f406ef10 0x7f36f40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f36fdffb640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] conn(0x7f36f4078d10 0x7f36f407b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36f407b810 con 0x7f36f4078d10 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f8093240 con 0x7f37080fd400 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f370dc3e640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] conn(0x7f36f4078d10 0x7f36f407b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f370d43d640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f36f406ef10 0x7f36f40713c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37040041d0 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.597+0000 7f370dc3e640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] conn(0x7f36f4078d10 0x7f36f407b140 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:51.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.598+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== osd.1 v2:172.21.15.173:6810/2339789859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f36f407b810 con 0x7f36f4078d10 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 --> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37080fc050 con 0x7f36f4078d10 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f36fdffb640 1 -- 172.21.15.173:0/1278567208 <== osd.1 v2:172.21.15.173:6810/2339789859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37080fc050 con 0x7f36f4078d10 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] conn(0x7f36f4078d10 msgr2=0x7f36f407b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6810/2339789859,v1:172.21.15.173:6811/2339789859] conn(0x7f36f4078d10 0x7f36f407b140 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f36f406ef10 msgr2=0x7f36f40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f36f406ef10 0x7f36f40713c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37040041d0 tx=0x7f3704009040 comp rx=0 tx=0).stop 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 msgr2=0x7f3708112e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 --2- 172.21.15.173:0/1278567208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37080fd400 0x7f3708112e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009780 tx=0x7f36f8009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370dc3e640 1 -- 172.21.15.173:0/1278567208 reap_dead start 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 shutdown_connections 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.610+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 >> 172.21.15.173:0/1278567208 conn(0x7f3708073600 msgr2=0x7f37080fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.611+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 shutdown_connections 2024-09-11T08:18:51.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:51.611+0000 7f370f6a1640 1 -- 172.21.15.173:0/1278567208 wait complete. 2024-09-11T08:18:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:51 smithi173 ceph-mon[29664]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:51 smithi173 ceph-mon[40835]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:51 smithi175 ceph-mon[32813]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T08:18:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:53 smithi173 ceph-mon[29664]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:53 smithi173 ceph-mon[40835]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:53 smithi175 ceph-mon[32813]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T08:18:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:18:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:18:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:18:56.064 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:55 smithi173 ceph-mon[29664]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-11T08:18:56.064 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:55 smithi173 ceph-mon[40835]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-11T08:18:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:55 smithi175 ceph-mon[32813]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-11T08:18:56.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:18:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- 172.21.15.173:0/502703283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d400fd8b0 msgr2=0x7f5d400fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- 172.21.15.173:0/502703283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d400fd8b0 0x7f5d400fdc80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d34004950 tx=0x7f5d34009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- 172.21.15.173:0/502703283 shutdown_connections 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- 172.21.15.173:0/502703283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d40106e60 0x7f5d40109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- 172.21.15.173:0/502703283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fe250 0x7f5d40106890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- 172.21.15.173:0/502703283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d400fd8b0 0x7f5d400fdc80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- 172.21.15.173:0/502703283 >> 172.21.15.173:0/502703283 conn(0x7f5d40071c00 msgr2=0x7f5d40072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- 172.21.15.173:0/502703283 shutdown_connections 2024-09-11T08:18:57.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- 172.21.15.173:0/502703283 wait complete. 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 Processor -- start 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 -- start start 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 0x7f5d40112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.096+0000 7f5d44c75640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d400fe250 0x7f5d40113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d40106e60 0x7f5d4010cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4010d430 con 0x7f5d400fd8b0 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4010d5a0 con 0x7f5d400fe250 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4010d760 con 0x7f5d40106e60 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 0x7f5d40112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d40106e60 0x7f5d4010cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 0x7f5d40112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60440/0 (socket says 172.21.15.173:60440) 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3e59c640 1 -- 172.21.15.173:0/3454238896 learned_addr learned my addr 172.21.15.173:0/3454238896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:57.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3dd9b640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d400fe250 0x7f5d40113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 -- 172.21.15.173:0/3454238896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d400fe250 msgr2=0x7f5d40113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d400fe250 0x7f5d40113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 -- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 msgr2=0x7f5d40112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 0x7f5d40112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30005040 con 0x7f5d40106e60 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3e59c640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d400fd8b0 0x7f5d40112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3dd9b640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d400fe250 0x7f5d40113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d3ed9d640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d40106e60 0x7f5d4010cde0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c860 tx=0x7f5d38007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38004020 con 0x7f5d40106e60 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f5d38004180 con 0x7f5d40106e60 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d34005040 con 0x7f5d40106e60 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380036a0 con 0x7f5d40106e60 2024-09-11T08:18:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.097+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d40119aa0 con 0x7f5d40106e60 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.098+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d4005ddd0 con 0x7f5d40106e60 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f5d3800a850 con 0x7f5d40106e60 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d2806ef10 0x7f5d280713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d3e59c640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d2806ef10 0x7f5d280713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f5d3808ece0 con 0x7f5d40106e60 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] conn(0x7f5d28078d10 0x7f5d2807b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d2807b810 con 0x7f5d28078d10 2024-09-11T08:18:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d38091320 con 0x7f5d40106e60 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.099+0000 7f5d3dd9b640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] conn(0x7f5d28078d10 0x7f5d2807b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.100+0000 7f5d3e59c640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d2806ef10 0x7f5d280713c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d3402a570 tx=0x7f5d34035040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.100+0000 7f5d3dd9b640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] conn(0x7f5d28078d10 0x7f5d2807b140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.100+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== osd.3 v2:172.21.15.173:6826/643295685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5d2807b810 con 0x7f5d28078d10 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.112+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 --> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d40065b20 con 0x7f5d28078d10 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d2effd640 1 -- 172.21.15.173:0/3454238896 <== osd.3 v2:172.21.15.173:6826/643295685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5d40065b20 con 0x7f5d28078d10 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] conn(0x7f5d28078d10 msgr2=0x7f5d2807b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6826/643295685,v1:172.21.15.173:6827/643295685] conn(0x7f5d28078d10 0x7f5d2807b140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d2806ef10 msgr2=0x7f5d280713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d2806ef10 0x7f5d280713c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d3402a570 tx=0x7f5d34035040 comp rx=0 tx=0).stop 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d40106e60 msgr2=0x7f5d4010cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 --2- 172.21.15.173:0/3454238896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d40106e60 0x7f5d4010cde0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c860 tx=0x7f5d38007e00 comp rx=0 tx=0).stop 2024-09-11T08:18:57.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d3ed9d640 1 -- 172.21.15.173:0/3454238896 reap_dead start 2024-09-11T08:18:57.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 shutdown_connections 2024-09-11T08:18:57.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 >> 172.21.15.173:0/3454238896 conn(0x7f5d40071c00 msgr2=0x7f5d40107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:57.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 shutdown_connections 2024-09-11T08:18:57.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:57.113+0000 7f5d44c75640 1 -- 172.21.15.173:0/3454238896 wait complete. 2024-09-11T08:18:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:57.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:18:57.898 INFO:teuthology.orchestra.run.smithi173.stdout:55834574893 2024-09-11T08:18:57.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 -- 172.21.15.173:0/1406509604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e01028c0 msgr2=0x7f43e0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 --2- 172.21.15.173:0/1406509604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e01028c0 0x7f43e0102c90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43d0004980 tx=0x7f43d0009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 -- 172.21.15.173:0/1406509604 shutdown_connections 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 --2- 172.21.15.173:0/1406509604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e00fd250 0x7f43e0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 --2- 172.21.15.173:0/1406509604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43e00fc8a0 0x7f43e00fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 --2- 172.21.15.173:0/1406509604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e01028c0 0x7f43e0102c90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 -- 172.21.15.173:0/1406509604 >> 172.21.15.173:0/1406509604 conn(0x7f43e00f8400 msgr2=0x7f43e00fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 -- 172.21.15.173:0/1406509604 shutdown_connections 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 -- 172.21.15.173:0/1406509604 wait complete. 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.254+0000 7f43e5859640 1 Processor -- start 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 -- start start 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e00fc8a0 0x7f43e0112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 0x7f43e0113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43e01028c0 0x7f43e010cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e010d3f0 con 0x7f43e00fd250 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e010d560 con 0x7f43e00fc8a0 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e010d720 con 0x7f43e01028c0 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 0x7f43e0113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 0x7f43e0113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60378/0 (socket says 172.21.15.173:60378) 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43df7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43e01028c0 0x7f43e010cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 -- 172.21.15.173:0/3699689095 learned_addr learned my addr 172.21.15.173:0/3699689095 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43deffd640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e00fc8a0 0x7f43e0112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 -- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43e01028c0 msgr2=0x7f43e010cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43e01028c0 0x7f43e010cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 -- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e00fc8a0 msgr2=0x7f43e0112c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e00fc8a0 0x7f43e0112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8005040 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43de7fc640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 0x7f43e0113150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009780 tx=0x7f43c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80099c0 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d0005040 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f43c800f040 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.255+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8013bf0 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.256+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e0119a60 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.256+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43e005ddd0 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.257+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f43c800ebb0 con 0x7f43e00fd250 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.257+0000 7f43d77fe640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f43cc06ef10 0x7f43cc0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.257+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f43c808e940 con 0x7f43e00fd250 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43deffd640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f43cc06ef10 0x7f43cc0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43d77fe640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] conn(0x7f43cc078d10 0x7f43cc07b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43cc07b810 con 0x7f43cc078d10 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c8093240 con 0x7f43e00fd250 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43deffd640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f43cc06ef10 0x7f43cc0713c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009f80 tx=0x7f43d0009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43df7fe640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] conn(0x7f43cc078d10 0x7f43cc07b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.258+0000 7f43df7fe640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] conn(0x7f43cc078d10 0x7f43cc07b140 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.259+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== osd.6 v2:172.21.15.175:6816/2487468341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f43cc07b810 con 0x7f43cc078d10 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.271+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 --> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43e005e180 con 0x7f43cc078d10 2024-09-11T08:18:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43d77fe640 1 -- 172.21.15.173:0/3699689095 <== osd.6 v2:172.21.15.175:6816/2487468341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f43e005e180 con 0x7f43cc078d10 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] conn(0x7f43cc078d10 msgr2=0x7f43cc07b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.175:6816/2487468341,v1:172.21.15.175:6817/2487468341] conn(0x7f43cc078d10 0x7f43cc07b140 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f43cc06ef10 msgr2=0x7f43cc0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f43cc06ef10 0x7f43cc0713c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009f80 tx=0x7f43d0009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 msgr2=0x7f43e0113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 --2- 172.21.15.173:0/3699689095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00fd250 0x7f43e0113150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009780 tx=0x7f43c8009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43df7fe640 1 -- 172.21.15.173:0/3699689095 reap_dead start 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 shutdown_connections 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 >> 172.21.15.173:0/3699689095 conn(0x7f43e00f8400 msgr2=0x7f43e00f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 shutdown_connections 2024-09-11T08:18:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.272+0000 7f43e5859640 1 -- 172.21.15.173:0/3699689095 wait complete. 2024-09-11T08:18:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:57 smithi173 ceph-mon[29664]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:18:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:57 smithi173 ceph-mon[40835]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:18:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:57 smithi175 ceph-mon[32813]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 -- 172.21.15.173:0/1648569474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e341028e0 msgr2=0x7f7e34102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 --2- 172.21.15.173:0/1648569474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e341028e0 0x7f7e34102cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e300048c0 tx=0x7f7e30009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 -- 172.21.15.173:0/1648569474 shutdown_connections 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 --2- 172.21.15.173:0/1648569474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e340fd400 0x7f7e34109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 --2- 172.21.15.173:0/1648569474 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fca50 0x7f7e340fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 --2- 172.21.15.173:0/1648569474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e341028e0 0x7f7e34102cb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.469+0000 7f7e3c352640 1 -- 172.21.15.173:0/1648569474 >> 172.21.15.173:0/1648569474 conn(0x7f7e34073600 msgr2=0x7f7e34073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- 172.21.15.173:0/1648569474 shutdown_connections 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- 172.21.15.173:0/1648569474 wait complete. 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 Processor -- start 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- start start 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 0x7f7e34112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fd400 0x7f7e34113110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e341028e0 0x7f7e3410cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3410d3b0 con 0x7f7e340fca50 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3410d520 con 0x7f7e341028e0 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3c352640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3410d6e0 con 0x7f7e340fd400 2024-09-11T08:18:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3a0ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 0x7f7e34112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e398ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fd400 0x7f7e34113110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3a0ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 0x7f7e34112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60418/0 (socket says 172.21.15.173:60418) 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e398ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fd400 0x7f7e34113110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46468/0 (socket says 172.21.15.173:46468) 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.470+0000 7f7e3a0ee640 1 -- 172.21.15.173:0/4261019756 learned_addr learned my addr 172.21.15.173:0/4261019756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a8ef640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e341028e0 0x7f7e3410cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 -- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fd400 msgr2=0x7f7e34113110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e340fd400 0x7f7e34113110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 -- 172.21.15.173:0/4261019756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e341028e0 msgr2=0x7f7e3410cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e341028e0 0x7f7e3410cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28005040 con 0x7f7e340fca50 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3a0ee640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 0x7f7e34112bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e30004890 tx=0x7f7e30035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30009350 con 0x7f7e340fca50 2024-09-11T08:18:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f7e300094b0 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e30005040 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3003c410 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.471+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e34119a20 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.472+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e3405ddd0 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f7e30030020 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f7e2006ef10 0x7f7e200713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f7e300ae530 con 0x7f7e340fca50 2024-09-11T08:18:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e398ed640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f7e2006ef10 0x7f7e200713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] conn(0x7f7e20078d10 0x7f7e2007b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e2007b810 con 0x7f7e20078d10 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e300b0b70 con 0x7f7e340fca50 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e3a8ef640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] conn(0x7f7e20078d10 0x7f7e2007b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.473+0000 7f7e398ed640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f7e2006ef10 0x7f7e200713c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007fd0 tx=0x7f7e2800b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.474+0000 7f7e3a8ef640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] conn(0x7f7e20078d10 0x7f7e2007b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.474+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== osd.2 v2:172.21.15.173:6818/151053591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7e2007b810 con 0x7f7e20078d10 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.486+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 --> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e340fe000 con 0x7f7e20078d10 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e26ffd640 1 -- 172.21.15.173:0/4261019756 <== osd.2 v2:172.21.15.173:6818/151053591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e340fe000 con 0x7f7e20078d10 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] conn(0x7f7e20078d10 msgr2=0x7f7e2007b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6818/151053591,v1:172.21.15.173:6819/151053591] conn(0x7f7e20078d10 0x7f7e2007b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f7e2006ef10 msgr2=0x7f7e200713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f7e2006ef10 0x7f7e200713c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007fd0 tx=0x7f7e2800b040 comp rx=0 tx=0).stop 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 msgr2=0x7f7e34112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 --2- 172.21.15.173:0/4261019756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e340fca50 0x7f7e34112bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e30004890 tx=0x7f7e30035040 comp rx=0 tx=0).stop 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3a8ef640 1 -- 172.21.15.173:0/4261019756 reap_dead start 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 shutdown_connections 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 >> 172.21.15.173:0/4261019756 conn(0x7f7e34073600 msgr2=0x7f7e340fb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 shutdown_connections 2024-09-11T08:18:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.487+0000 7f7e3c352640 1 -- 172.21.15.173:0/4261019756 wait complete. 2024-09-11T08:18:58.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.352+0000 7f62d8e38640 1 -- 172.21.15.173:0/645092830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fc1c0 msgr2=0x7f62d41085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.352+0000 7f62d8e38640 1 --2- 172.21.15.173:0/645092830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fc1c0 0x7f62d41085e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f62c4004980 tx=0x7f62c4009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- 172.21.15.173:0/645092830 shutdown_connections 2024-09-11T08:18:58.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- 172.21.15.173:0/645092830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fc1c0 0x7f62d41085e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- 172.21.15.173:0/645092830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d40fb810 0x7f62d40fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- 172.21.15.173:0/645092830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d4101830 0x7f62d4101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- 172.21.15.173:0/645092830 >> 172.21.15.173:0/645092830 conn(0x7f62d40713f0 msgr2=0x7f62d40f99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- 172.21.15.173:0/645092830 shutdown_connections 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- 172.21.15.173:0/645092830 wait complete. 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 Processor -- start 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- start start 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fb810 0x7f62d4114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 0x7f62d4115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d4101830 0x7f62d410ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d410f3c0 con 0x7f62d40fc1c0 2024-09-11T08:18:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d410f530 con 0x7f62d4101830 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.353+0000 7f62d8e38640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d410f6f0 con 0x7f62d40fb810 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 0x7f62d4115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d259c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fb810 0x7f62d4114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 0x7f62d4115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60398/0 (socket says 172.21.15.173:60398) 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 -- 172.21.15.173:0/3968471713 learned_addr learned my addr 172.21.15.173:0/3968471713 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d2d9d640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d4101830 0x7f62d410ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 -- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fb810 msgr2=0x7f62d4114be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d40fb810 0x7f62d4114be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 -- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d4101830 msgr2=0x7f62d410ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d4101830 0x7f62d410ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0098b0 con 0x7f62d40fc1c0 2024-09-11T08:18:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d1d9b640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 0x7f62d4115120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62bc002ad0 tx=0x7f62bc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc007c30 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4005040 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f62bc00f040 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc009340 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.354+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d411ba30 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.355+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62d40668f0 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f62bc009770 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f62c006ef10 0x7f62c00713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62d259c640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f62c006ef10 0x7f62c00713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f62bc08e6d0 con 0x7f62d40fc1c0 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] conn(0x7f62c0078d10 0x7f62c007b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62c007b810 con 0x7f62c0078d10 2024-09-11T08:18:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.356+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62bc090d10 con 0x7f62d40fc1c0 2024-09-11T08:18:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.357+0000 7f62d259c640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f62c006ef10 0x7f62c00713c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001610 tx=0x7f62cc004c50 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.357+0000 7f62d2d9d640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] conn(0x7f62c0078d10 0x7f62c007b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.357+0000 7f62d2d9d640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] conn(0x7f62c0078d10 0x7f62c007b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.358+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== osd.7 v2:172.21.15.175:6824/3505122552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f62c007b810 con 0x7f62c0078d10 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.370+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 --> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62d4066ca0 con 0x7f62c0078d10 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62caffd640 1 -- 172.21.15.173:0/3968471713 <== osd.7 v2:172.21.15.175:6824/3505122552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f62d4066ca0 con 0x7f62c0078d10 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] conn(0x7f62c0078d10 msgr2=0x7f62c007b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.175:6824/3505122552,v1:172.21.15.175:6825/3505122552] conn(0x7f62c0078d10 0x7f62c007b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f62c006ef10 msgr2=0x7f62c00713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f62c006ef10 0x7f62c00713c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001610 tx=0x7f62cc004c50 comp rx=0 tx=0).stop 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 msgr2=0x7f62d4115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 --2- 172.21.15.173:0/3968471713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d40fc1c0 0x7f62d4115120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62bc002ad0 tx=0x7f62bc004600 comp rx=0 tx=0).stop 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d2d9d640 1 -- 172.21.15.173:0/3968471713 reap_dead start 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 shutdown_connections 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 >> 172.21.15.173:0/3968471713 conn(0x7f62d40713f0 msgr2=0x7f62d4065f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 shutdown_connections 2024-09-11T08:18:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:56.371+0000 7f62d8e38640 1 -- 172.21.15.173:0/3968471713 wait complete. 2024-09-11T08:18:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.089+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/1261819424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e40fc1b0 msgr2=0x7fe8e4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.089+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/1261819424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e40fc1b0 0x7fe8e4108580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc004980 tx=0x7fe8dc009da0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/1261819424 shutdown_connections 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/1261819424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e40fc1b0 0x7fe8e4108580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/1261819424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fb800 0x7fe8e40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/1261819424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e41017d0 0x7fe8e4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/1261819424 >> 172.21.15.173:0/1261819424 conn(0x7fe8e4071c00 msgr2=0x7fe8e4072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/1261819424 shutdown_connections 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/1261819424 wait complete. 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.090+0000 7fe8e9fdf640 1 Processor -- start 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 -- start start 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e40fb800 0x7fe8e410db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 0x7fe8e410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 0x7fe8e410e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4118dd0 con 0x7fe8e40fc1b0 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4118f40 con 0x7fe8e40fb800 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e9fdf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4119100 con 0x7fe8e41017d0 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 0x7fe8e410e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 0x7fe8e410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 0x7fe8e410e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46504/0 (socket says 172.21.15.173:46504) 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 0x7fe8e410e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60468/0 (socket says 172.21.15.173:60468) 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 -- 172.21.15.173:0/288265298 learned_addr learned my addr 172.21.15.173:0/288265298 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:18:59.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e37fe640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e40fb800 0x7fe8e410db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 -- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e40fb800 msgr2=0x7fe8e410db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e40fb800 0x7fe8e410db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 -- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 msgr2=0x7fe8e410e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 0x7fe8e410e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8005040 con 0x7fe8e41017d0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e2ffd640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8e40fc1b0 0x7fe8e410e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.091+0000 7fe8e3fff640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 0x7fe8e410e5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc004950 tx=0x7fe8dc035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.092+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc007d00 con 0x7fe8e41017d0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.092+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fe8dc02ae20 con 0x7fe8e41017d0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.092+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc032640 con 0x7fe8e41017d0 2024-09-11T08:18:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.092+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc005040 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.092+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e4119690 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.093+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8e40fa790 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.093+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fe8dc030020 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8cbfff640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fe8cc06ef10 0x7fe8cc0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7fe8dc0ae3d0 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8e37fe640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fe8cc06ef10 0x7fe8cc0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8cbfff640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] conn(0x7fe8cc078d10 0x7fe8cc07b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8cc07b810 con 0x7fe8cc078d10 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8dc0b09b0 con 0x7fe8e41017d0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8e37fe640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fe8cc06ef10 0x7fe8cc0713c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004550 tx=0x7fe8d4009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.094+0000 7fe8e2ffd640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] conn(0x7fe8cc078d10 0x7fe8cc07b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:18:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.095+0000 7fe8e2ffd640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] conn(0x7fe8cc078d10 0x7fe8cc07b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.095+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== osd.4 v2:172.21.15.175:6800/1661927425 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe8cc07b810 con 0x7fe8cc078d10 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.108+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 --> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8e40fcef0 con 0x7fe8cc078d10 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.108+0000 7fe8cbfff640 1 -- 172.21.15.173:0/288265298 <== osd.4 v2:172.21.15.175:6800/1661927425 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe8e40fcef0 con 0x7fe8cc078d10 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] conn(0x7fe8cc078d10 msgr2=0x7fe8cc07b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.175:6800/1661927425,v1:172.21.15.175:6801/1661927425] conn(0x7fe8cc078d10 0x7fe8cc07b140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fe8cc06ef10 msgr2=0x7fe8cc0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fe8cc06ef10 0x7fe8cc0713c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004550 tx=0x7fe8d4009040 comp rx=0 tx=0).stop 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 msgr2=0x7fe8e410e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 --2- 172.21.15.173:0/288265298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8e41017d0 0x7fe8e410e5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc004950 tx=0x7fe8dc035040 comp rx=0 tx=0).stop 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e3fff640 1 -- 172.21.15.173:0/288265298 reap_dead start 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 shutdown_connections 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 >> 172.21.15.173:0/288265298 conn(0x7fe8e4071c00 msgr2=0x7fe8e40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:18:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 shutdown_connections 2024-09-11T08:18:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:18:58.109+0000 7fe8e9fdf640 1 -- 172.21.15.173:0/288265298 wait complete. 2024-09-11T08:18:59.737 INFO:teuthology.orchestra.run.smithi173.stdout:133143986207 2024-09-11T08:18:59.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T08:18:59.961 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:18:59 smithi173 ceph-mon[40835]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:18:59.961 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:18:59 smithi173 ceph-mon[29664]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:00.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:18:59 smithi175 ceph-mon[32813]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:01.101 INFO:teuthology.orchestra.run.smithi173.stdout:210453397520 2024-09-11T08:19:01.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T08:19:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- 172.21.15.173:0/912338120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e00fc1b0 msgr2=0x7ff1e0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 --2- 172.21.15.173:0/912338120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e00fc1b0 0x7ff1e0108580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009d50 tx=0x7ff1d8004c50 comp rx=0 tx=0).stop 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- 172.21.15.173:0/912338120 shutdown_connections 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 --2- 172.21.15.173:0/912338120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e00fc1b0 0x7ff1e0108580 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 --2- 172.21.15.173:0/912338120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 --2- 172.21.15.173:0/912338120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e01017d0 0x7ff1e0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- 172.21.15.173:0/912338120 >> 172.21.15.173:0/912338120 conn(0x7ff1e0071c00 msgr2=0x7ff1e0072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- 172.21.15.173:0/912338120 shutdown_connections 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- 172.21.15.173:0/912338120 wait complete. 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 Processor -- start 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.542+0000 7ff1e797f640 1 -- start start 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00fc1b0 0x7ff1e00fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e01017d0 0x7ff1e00fe070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:01.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e011afc0 con 0x7ff1e01017d0 2024-09-11T08:19:01.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e011b130 con 0x7ff1e00fc1b0 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e011b2f0 con 0x7ff1e00fb800 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46510/0 (socket says 172.21.15.173:46510) 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e5f1c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e01017d0 0x7ff1e00fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 -- 172.21.15.173:0/1248995197 learned_addr learned my addr 172.21.15.173:0/1248995197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e4f1a640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00fc1b0 0x7ff1e00fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 -- 172.21.15.173:0/1248995197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00fc1b0 msgr2=0x7ff1e00fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00fc1b0 0x7ff1e00fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 -- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e01017d0 msgr2=0x7ff1e00fe070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e01017d0 0x7ff1e00fe070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0005040 con 0x7ff1e00fb800 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e5f1c640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1e01017d0 0x7ff1e00fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e571b640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fd5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c8b0 tx=0x7ff1dc004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00cea0 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7ff1dc00ac90 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d80098b0 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.543+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc012ad0 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.544+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e011b9e0 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.544+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1e00fa080 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7ff1dc00a850 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff1cc06ef10 0x7ff1cc0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7ff1dc08e850 con 0x7ff1e00fb800 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1e4f1a640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff1cc06ef10 0x7ff1cc0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] conn(0x7ff1cc078d90 0x7ff1cc07b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1cc07b890 con 0x7ff1cc078d90 2024-09-11T08:19:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.545+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1dc093240 con 0x7ff1e00fb800 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.546+0000 7ff1e5f1c640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] conn(0x7ff1cc078d90 0x7ff1cc07b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.546+0000 7ff1e4f1a640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff1cc06ef10 0x7ff1cc0713c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00fed20 tx=0x7ff1d0009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.546+0000 7ff1e5f1c640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] conn(0x7ff1cc078d90 0x7ff1cc07b1c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.546+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== osd.0 v2:172.21.15.173:6802/3725419528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff1cc07b890 con 0x7ff1cc078d90 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 --> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1e00fcef0 con 0x7ff1cc078d90 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1d5ffb640 1 -- 172.21.15.173:0/1248995197 <== osd.0 v2:172.21.15.173:6802/3725419528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1e00fcef0 con 0x7ff1cc078d90 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] conn(0x7ff1cc078d90 msgr2=0x7ff1cc07b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6802/3725419528,v1:172.21.15.173:6803/3725419528] conn(0x7ff1cc078d90 0x7ff1cc07b1c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff1cc06ef10 msgr2=0x7ff1cc0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff1cc06ef10 0x7ff1cc0713c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00fed20 tx=0x7ff1d0009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 msgr2=0x7ff1e00fd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 --2- 172.21.15.173:0/1248995197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1e00fb800 0x7ff1e00fd5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c8b0 tx=0x7ff1dc004430 comp rx=0 tx=0).stop 2024-09-11T08:19:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e5f1c640 1 -- 172.21.15.173:0/1248995197 reap_dead start 2024-09-11T08:19:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 shutdown_connections 2024-09-11T08:19:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 >> 172.21.15.173:0/1248995197 conn(0x7ff1e0071c00 msgr2=0x7ff1e00ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 shutdown_connections 2024-09-11T08:19:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.559+0000 7ff1e797f640 1 -- 172.21.15.173:0/1248995197 wait complete. 2024-09-11T08:19:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:01 smithi173 ceph-mon[29664]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:01 smithi173 ceph-mon[40835]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:01 smithi175 ceph-mon[32813]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:02.541 INFO:teuthology.orchestra.run.smithi173.stdout:77309411369 2024-09-11T08:19:02.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T08:19:02.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 -- 172.21.15.173:0/3205760714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 msgr2=0x7fcfec1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 --2- 172.21.15.173:0/3205760714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec1085d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009cd0 tx=0x7fcfe4004d10 comp rx=0 tx=0).stop 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 -- 172.21.15.173:0/3205760714 shutdown_connections 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 --2- 172.21.15.173:0/3205760714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec1085d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 --2- 172.21.15.173:0/3205760714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfec102190 0x7fcfec0fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 --2- 172.21.15.173:0/3205760714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec101880 0x7fcfec101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 -- 172.21.15.173:0/3205760714 >> 172.21.15.173:0/3205760714 conn(0x7fcfec074e10 msgr2=0x7fcfec0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 -- 172.21.15.173:0/3205760714 shutdown_connections 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.677+0000 7fcff15d0640 1 -- 172.21.15.173:0/3205760714 wait complete. 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 Processor -- start 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 -- start start 2024-09-11T08:19:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec10dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfec101880 0x7fcfec10e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec102190 0x7fcfec10e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec118df0 con 0x7fcfec102190 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec118f60 con 0x7fcfec101880 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcff15d0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec119120 con 0x7fcfec0fc670 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec10dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeb7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec102190 0x7fcfec10e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec10dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46528/0 (socket says 172.21.15.173:46528) 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeaffd640 1 -- 172.21.15.173:0/191663120 learned_addr learned my addr 172.21.15.173:0/191663120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfea7fc640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfec101880 0x7fcfec10e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeaffd640 1 -- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfec101880 msgr2=0x7fcfec10e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.678+0000 7fcfeaffd640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfec101880 0x7fcfec10e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfeaffd640 1 -- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec102190 msgr2=0x7fcfec10e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfeaffd640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec102190 0x7fcfec10e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfeaffd640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc005040 con 0x7fcfec0fc670 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfeb7fe640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfec102190 0x7fcfec10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfeaffd640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec10dc60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009780 tx=0x7fcfdc009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0099c0 con 0x7fcfec0fc670 2024-09-11T08:19:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fcfdc00f040 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc013bf0 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40098b0 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.679+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec1196e0 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.680+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfec072620 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.680+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fcfdc00ebb0 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfd37fe640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcfd406ef10 0x7fcfd40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7fcfdc08e810 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfea7fc640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcfd406ef10 0x7fcfd40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfd37fe640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] conn(0x7fcfd4078d90 0x7fcfd407b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfd407b890 con 0x7fcfd4078d90 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfdc093240 con 0x7fcfec0fc670 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfea7fc640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcfd406ef10 0x7fcfd40713c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0fb5d0 tx=0x7fcfe000b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.681+0000 7fcfeb7fe640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] conn(0x7fcfd4078d90 0x7fcfd407b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.682+0000 7fcfeb7fe640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] conn(0x7fcfd4078d90 0x7fcfd407b1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.683+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== osd.5 v2:172.21.15.175:6808/3173894990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcfd407b890 con 0x7fcfd4078d90 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.695+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 --> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfec0fcfa0 con 0x7fcfd4078d90 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.696+0000 7fcfd37fe640 1 -- 172.21.15.173:0/191663120 <== osd.5 v2:172.21.15.175:6808/3173894990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcfec0fcfa0 con 0x7fcfd4078d90 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] conn(0x7fcfd4078d90 msgr2=0x7fcfd407b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.175:6808/3173894990,v1:172.21.15.175:6809/3173894990] conn(0x7fcfd4078d90 0x7fcfd407b1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcfd406ef10 msgr2=0x7fcfd40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcfd406ef10 0x7fcfd40713c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0fb5d0 tx=0x7fcfe000b040 comp rx=0 tx=0).stop 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 msgr2=0x7fcfec10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 --2- 172.21.15.173:0/191663120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfec0fc670 0x7fcfec10dc60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009780 tx=0x7fcfdc009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcfeb7fe640 1 -- 172.21.15.173:0/191663120 reap_dead start 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 shutdown_connections 2024-09-11T08:19:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 >> 172.21.15.173:0/191663120 conn(0x7fcfec074e10 msgr2=0x7fcfec071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 shutdown_connections 2024-09-11T08:19:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:01.697+0000 7fcff15d0640 1 -- 172.21.15.173:0/191663120 wait complete. 2024-09-11T08:19:03.331 INFO:teuthology.orchestra.run.smithi173.stdout:184683593749 2024-09-11T08:19:03.332 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T08:19:03.902 INFO:teuthology.orchestra.run.smithi173.stdout:34359738418 2024-09-11T08:19:03.903 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T08:19:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:03 smithi173 ceph-mon[29664]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:03 smithi173 ceph-mon[40835]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:03 smithi175 ceph-mon[32813]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:04.935 INFO:teuthology.orchestra.run.smithi173.stdout:158913789979 2024-09-11T08:19:04.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T08:19:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:05.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:05.449 INFO:teuthology.orchestra.run.smithi173.stdout:111669149731 2024-09-11T08:19:05.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T08:19:05.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:05 smithi173 podman[75574]: 2024-09-11 08:19:05.659694223 +0000 UTC m=+0.671292765 container create 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:05 smithi175 ceph-mon[32813]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:19:06.095 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:06.136 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:06.137 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:06.196 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:05 smithi173 ceph-mon[29664]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:19:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:05 smithi173 ceph-mon[40835]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:19:06.217 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 podman[75574]: 2024-09-11 08:19:06.021122681 +0000 UTC m=+1.032721236 container init 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:06.217 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 podman[75574]: 2024-09-11 08:19:06.025925218 +0000 UTC m=+1.037523760 container start 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:06.217 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.038Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.038Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.039Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.173 port=9094 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.040Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.062Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.063Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.065Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:06.065Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 bash[75574]: 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 2024-09-11T08:19:06.218 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:06 smithi173 systemd[1]: Started Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:06.550 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE Bus STOPPING 2024-09-11T08:19:06.550 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-11T08:19:06.550 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE Bus STOPPED 2024-09-11T08:19:06.550 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE Bus STARTING 2024-09-11T08:19:06.551 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE Serving on http://:::9283 2024-09-11T08:19:06.551 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:06] ENGINE Bus STARTED 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-11T08:19:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:08.211 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:08 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:08.040Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00054775s 2024-09-11T08:19:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:08 smithi173 ceph-mon[29664]: Deploying daemon grafana.a on smithi175 2024-09-11T08:19:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:08 smithi173 ceph-mon[29664]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:08 smithi173 ceph-mon[40835]: Deploying daemon grafana.a on smithi175 2024-09-11T08:19:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:08 smithi173 ceph-mon[40835]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:08 smithi175 ceph-mon[32813]: Deploying daemon grafana.a on smithi175 2024-09-11T08:19:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:08 smithi175 ceph-mon[32813]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:10.383 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:10 smithi173 ceph-mon[29664]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:10.384 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:10.384 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:10 smithi173 ceph-mon[40835]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:10.384 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:10.420 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:10.421 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:10.423 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:10 smithi175 ceph-mon[32813]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 -- 172.21.15.173:0/1370628211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fb950 msgr2=0x7f228c0fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 --2- 172.21.15.173:0/1370628211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fb950 0x7f228c0fbdc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2274004980 tx=0x7f2274009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 -- 172.21.15.173:0/1370628211 shutdown_connections 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 --2- 172.21.15.173:0/1370628211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c0fc300 0x7f228c108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 --2- 172.21.15.173:0/1370628211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fb950 0x7f228c0fbdc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 --2- 172.21.15.173:0/1370628211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c101790 0x7f228c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 -- 172.21.15.173:0/1370628211 >> 172.21.15.173:0/1370628211 conn(0x7f228c0724d0 msgr2=0x7f228c0728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 -- 172.21.15.173:0/1370628211 shutdown_connections 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.019+0000 7f2291b76640 1 -- 172.21.15.173:0/1370628211 wait complete. 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 Processor -- start 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 -- start start 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c0fb950 0x7f228c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 0x7f228c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c10d360 con 0x7f228c101790 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c10d4d0 con 0x7f228c0fb950 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2291b76640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c10d690 con 0x7f228c0fc300 2024-09-11T08:19:11.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2283fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f228bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 0x7f228c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f228b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c0fb950 0x7f228c112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2283fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:60962/0 (socket says 172.21.15.173:60962) 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.020+0000 7f2283fff640 1 -- 172.21.15.173:0/3539433485 learned_addr learned my addr 172.21.15.173:0/3539433485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 -- 172.21.15.173:0/3539433485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c0fb950 msgr2=0x7f228c112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c0fb950 0x7f228c112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 -- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 msgr2=0x7f228c10cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 0x7f228c10cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 -- 172.21.15.173:0/3539433485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840098b0 con 0x7f228c0fc300 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f228bfff640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 0x7f228c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2283fff640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f227402d040 tx=0x7f2274039040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:11.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227402aca0 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2274005040 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f227402ae00 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274040840 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.021+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c0fd2b0 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.022+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c0fceb0 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.023+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f2274030020 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.023+0000 7f2288ff9640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 0x7f22780713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.023+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f22740b2da0 con 0x7f228c0fc300 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.023+0000 7f228b7fe640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 0x7f22780713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.023+0000 7f228b7fe640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 0x7f22780713c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f227c004eb0 tx=0x7f227c00b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:11.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.027+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f227407f910 con 0x7f228c0fc300 2024-09-11T08:19:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:11.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.198+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f228c10d880 con 0x7f228c0fc300 2024-09-11T08:19:11.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.198+0000 7f2288ff9640 1 -- 172.21.15.173:0/3539433485 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f227407f2b0 con 0x7f228c0fc300 2024-09-11T08:19:11.200 INFO:teuthology.orchestra.run.smithi173.stdout:77309411371 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 msgr2=0x7f22780713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 0x7f22780713c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f227c004eb0 tx=0x7f227c00b040 comp rx=0 tx=0).stop 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 msgr2=0x7f228c1130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f227402d040 tx=0x7f2274039040 comp rx=0 tx=0).stop 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 shutdown_connections 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f227806ef10 0x7f22780713c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c101790 0x7f228c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c0fc300 0x7f228c1130c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 --2- 172.21.15.173:0/3539433485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f228c0fb950 0x7f228c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:11.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 >> 172.21.15.173:0/3539433485 conn(0x7f228c0724d0 msgr2=0x7f228c0fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:11.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 shutdown_connections 2024-09-11T08:19:11.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:11.200+0000 7f2291b76640 1 -- 172.21.15.173:0/3539433485 wait complete. 2024-09-11T08:19:11.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3539433485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T08:19:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3539433485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T08:19:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3539433485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T08:19:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:12 smithi175 ceph-mon[32813]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:12.633 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:12 smithi173 ceph-mon[29664]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:12.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:12 smithi173 ceph-mon[40835]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:12.656 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411369 got 77309411371 for osd.2 2024-09-11T08:19:12.656 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:13.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 -- 172.21.15.173:0/111893388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0fb530 msgr2=0x7f03dc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:13.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 --2- 172.21.15.173:0/111893388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0fb530 0x7f03dc109700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f03cc004950 tx=0x7f03cc009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 -- 172.21.15.173:0/111893388 shutdown_connections 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 --2- 172.21.15.173:0/111893388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc0fb530 0x7f03dc109700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 --2- 172.21.15.173:0/111893388 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc0fae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 --2- 172.21.15.173:0/111893388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc102900 0x7f03dc102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 -- 172.21.15.173:0/111893388 >> 172.21.15.173:0/111893388 conn(0x7f03dc074e10 msgr2=0x7f03dc0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 -- 172.21.15.173:0/111893388 shutdown_connections 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.193+0000 7f03e388c640 1 -- 172.21.15.173:0/111893388 wait complete. 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 Processor -- start 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 -- start start 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc0fb530 0x7f03dc114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc10f3c0 con 0x7f03dc102900 2024-09-11T08:19:13.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc10f530 con 0x7f03dc0fb530 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e388c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc10f6f0 con 0x7f03dc1032a0 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e1e29640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49222/0 (socket says 172.21.15.173:49222) 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e1e29640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38410/0 (socket says 172.21.15.173:38410) 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 -- 172.21.15.173:0/3630935214 learned_addr learned my addr 172.21.15.173:0/3630935214 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e1628640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc0fb530 0x7f03dc114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 -- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 msgr2=0x7f03dc10ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 -- 172.21.15.173:0/3630935214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc0fb530 msgr2=0x7f03dc114be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc0fb530 0x7f03dc114be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e0e27640 1 -- 172.21.15.173:0/3630935214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0005040 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.194+0000 7f03e1e29640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03e0e27640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009450 tx=0x7f03d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0007bd0 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f03d000f040 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0013a80 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc005040 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.195+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc11ba30 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.196+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0fe120 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.196+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f03d000e930 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.197+0000 7f03d9ffb640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 0x7f03c40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.197+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f03d008e7e0 con 0x7f03dc102900 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.197+0000 7f03e1628640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 0x7f03c40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:13.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.197+0000 7f03e1628640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 0x7f03c40713c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03d4007fd0 tx=0x7f03d4009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:13.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.202+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f03d005b210 con 0x7f03dc102900 2024-09-11T08:19:13.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.368+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03dc04bf60 con 0x7f03dc102900 2024-09-11T08:19:13.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.369+0000 7f03d9ffb640 1 -- 172.21.15.173:0/3630935214 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03d005abb0 con 0x7f03dc102900 2024-09-11T08:19:13.370 INFO:teuthology.orchestra.run.smithi173.stdout:111669149734 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 msgr2=0x7f03c40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 0x7f03c40713c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03d4007fd0 tx=0x7f03d4009040 comp rx=0 tx=0).stop 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 msgr2=0x7f03dc115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009450 tx=0x7f03d0009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 shutdown_connections 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f03c406ef10 0x7f03c40713c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03dc1032a0 0x7f03dc10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03dc102900 0x7f03dc115120 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 --2- 172.21.15.173:0/3630935214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03dc0fb530 0x7f03dc114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:13.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 >> 172.21.15.173:0/3630935214 conn(0x7f03dc074e10 msgr2=0x7f03dc107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:13.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 shutdown_connections 2024-09-11T08:19:13.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.371+0000 7f03e388c640 1 -- 172.21.15.173:0/3630935214 wait complete. 2024-09-11T08:19:14.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.278+0000 7f137f287640 1 -- 172.21.15.173:0/4033574843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fe250 msgr2=0x7f1378106890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:14.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 --2- 172.21.15.173:0/4033574843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fe250 0x7f1378106890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1374004950 tx=0x7f1374009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 -- 172.21.15.173:0/4033574843 shutdown_connections 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 --2- 172.21.15.173:0/4033574843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1378106e60 0x7f1378109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 --2- 172.21.15.173:0/4033574843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fe250 0x7f1378106890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 --2- 172.21.15.173:0/4033574843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13780fd8b0 0x7f13780fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 -- 172.21.15.173:0/4033574843 >> 172.21.15.173:0/4033574843 conn(0x7f1378071c00 msgr2=0x7f1378072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 -- 172.21.15.173:0/4033574843 shutdown_connections 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 -- 172.21.15.173:0/4033574843 wait complete. 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 Processor -- start 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.279+0000 7f137f287640 1 -- start start 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780fe250 0x7f1378113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:14.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1378106e60 0x7f137810cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:14.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137810d430 con 0x7f13780fe250 2024-09-11T08:19:14.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137810d5a0 con 0x7f1378106e60 2024-09-11T08:19:14.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137f287640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137810d760 con 0x7f13780fd8b0 2024-09-11T08:19:14.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:14.031 INFO:teuthology.orchestra.run.smithi173.stdout:55834574897 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38436/0 (socket says 172.21.15.173:38436) 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 -- 172.21.15.173:0/1665441654 learned_addr learned my addr 172.21.15.173:0/1665441654 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137c822640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780fe250 0x7f1378113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d824640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1378106e60 0x7f137810cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 -- 172.21.15.173:0/1665441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1378106e60 msgr2=0x7f137810cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1378106e60 0x7f137810cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 -- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780fe250 msgr2=0x7f1378113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780fe250 0x7f1378113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 -- 172.21.15.173:0/1665441654 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700098b0 con 0x7f13780fd8b0 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f137d023640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f136800ebf0 tx=0x7f136800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:14.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.280+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368007c30 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.281+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f136800f040 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.281+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374005040 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.281+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680093e0 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.281+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378119aa0 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.282+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1378065b20 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.282+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f1368009750 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.283+0000 7f136dffb640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 0x7f13640713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.283+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f136808e670 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.283+0000 7f137c822640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 0x7f13640713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.283+0000 7f137c822640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 0x7f13640713c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1374009f80 tx=0x7f1374035040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.286+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f136804e2a0 con 0x7f13780fd8b0 2024-09-11T08:19:14.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.462+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f137810bb30 con 0x7f13780fd8b0 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.462+0000 7f136dffb640 1 -- 172.21.15.173:0/1665441654 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f136805b0a0 con 0x7f13780fd8b0 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 msgr2=0x7f13640713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 0x7f13640713c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1374009f80 tx=0x7f1374035040 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 msgr2=0x7f1378112c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f136800ebf0 tx=0x7f136800b040 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 shutdown_connections 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f136406ef10 0x7f13640713c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1378106e60 0x7f137810cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13780fe250 0x7f1378113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 --2- 172.21.15.173:0/1665441654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780fd8b0 0x7f1378112c50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 >> 172.21.15.173:0/1665441654 conn(0x7f1378071c00 msgr2=0x7f13781075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 shutdown_connections 2024-09-11T08:19:14.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:13.465+0000 7f137f287640 1 -- 172.21.15.173:0/1665441654 wait complete. 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[29664]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3630935214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1665441654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[40835]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3630935214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T08:19:14.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1665441654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T08:19:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:14 smithi175 ceph-mon[32813]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3630935214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T08:19:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1665441654' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T08:19:15.329 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:15.821 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574893 got 55834574897 for osd.1 2024-09-11T08:19:15.821 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:16.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:16.297 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:16 smithi173 ceph-mon[29664]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:16.298 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:16 smithi173 ceph-mon[40835]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:16.298 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:16 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:16.043Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003516811s 2024-09-11T08:19:16.472 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:16 smithi175 ceph-mon[32813]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.646+0000 7f5d606dc640 1 -- 172.21.15.173:0/2515677792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 msgr2=0x7f5d580fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.646+0000 7f5d606dc640 1 --2- 172.21.15.173:0/2515677792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fdc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d54004950 tx=0x7f5d54009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 -- 172.21.15.173:0/2515677792 shutdown_connections 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 --2- 172.21.15.173:0/2515677792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 0x7f5d58109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 --2- 172.21.15.173:0/2515677792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d58106890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 --2- 172.21.15.173:0/2515677792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fdc80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 -- 172.21.15.173:0/2515677792 >> 172.21.15.173:0/2515677792 conn(0x7f5d58071c00 msgr2=0x7f5d58072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 -- 172.21.15.173:0/2515677792 shutdown_connections 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 -- 172.21.15.173:0/2515677792 wait complete. 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 Processor -- start 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.647+0000 7f5d606dc640 1 -- start start 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d580fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 0x7f5d580fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5811b270 con 0x7f5d580fd8b0 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5811b3e0 con 0x7f5d58106e60 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5e478640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:16.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5e478640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49278/0 (socket says 172.21.15.173:49278) 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5e478640 1 -- 172.21.15.173:0/1016542811 learned_addr learned my addr 172.21.15.173:0/1016542811 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d580fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d606dc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5811b5a0 con 0x7f5d580fe250 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5ec79640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 0x7f5d580fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 -- 172.21.15.173:0/1016542811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 msgr2=0x7f5d580fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 0x7f5d580fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 -- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 msgr2=0x7f5d580fb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 -- 172.21.15.173:0/1016542811 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48005040 con 0x7f5d580fe250 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5e478640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d5dc77640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d580fbc20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009400 tx=0x7f5d48009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.648+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48007bb0 con 0x7f5d580fe250 2024-09-11T08:19:16.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.649+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d54005040 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.649+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f5d4800f040 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.649+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48013af0 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.649+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5811bb60 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.650+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58065b20 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.650+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f5d4800e8d0 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.651+0000 7f5d4effd640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 0x7f5d440713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.651+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f5d4808e790 con 0x7f5d580fe250 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.651+0000 7f5d5e478640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 0x7f5d440713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.651+0000 7f5d5e478640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 0x7f5d440713c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d5402a570 tx=0x7f5d54035040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:16.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.655+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5d4805b1c0 con 0x7f5d580fe250 2024-09-11T08:19:16.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.822+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5d580fcb70 con 0x7f5d580fe250 2024-09-11T08:19:16.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.822+0000 7f5d4effd640 1 -- 172.21.15.173:0/1016542811 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d4805ab60 con 0x7f5d580fe250 2024-09-11T08:19:16.823 INFO:teuthology.orchestra.run.smithi173.stdout:133143986210 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 msgr2=0x7f5d440713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 0x7f5d440713c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d5402a570 tx=0x7f5d54035040 comp rx=0 tx=0).stop 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 msgr2=0x7f5d580fbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d580fbc20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009400 tx=0x7f5d48009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 shutdown_connections 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f5d4406ef10 0x7f5d440713c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d58106e60 0x7f5d580fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d580fe250 0x7f5d580fbc20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 --2- 172.21.15.173:0/1016542811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d580fd8b0 0x7f5d580fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:16.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 >> 172.21.15.173:0/1016542811 conn(0x7f5d58071c00 msgr2=0x7f5d581075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:16.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 shutdown_connections 2024-09-11T08:19:16.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.824+0000 7f5d606dc640 1 -- 172.21.15.173:0/1016542811 wait complete. 2024-09-11T08:19:17.169 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 podman[65689]: 2024-09-11 08:19:16.974828528 +0000 UTC m=+0.014996040 image pull 954c08fa618887fe9a6fe572ae541197c77e625b05f4193df7898f5ac649ada9 quay.io/ceph/ceph-grafana:9.4.7 2024-09-11T08:19:17.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149731 got 111669149734 for osd.3 2024-09-11T08:19:17.439 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:17.485 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:17.486 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3968579357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T08:19:17.486 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1016542811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T08:19:17.486 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 podman[65689]: 2024-09-11 08:19:17.275545779 +0000 UTC m=+0.315713295 container init 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, vendor=Red Hat, Inc., description=Ceph Grafana Container, io.openshift.tags=base rhel8, name=ubi8, io.buildah.version=1.32.0, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , build-date=2022-04-29T11:48:11.055897, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, release=239.1651231664, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.openshift.expose-services=) 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 podman[65689]: 2024-09-11 08:19:17.280527682 +0000 UTC m=+0.320695194 container start 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a, vcs-type=git, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, name=ubi8, architecture=x86_64, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, description=Ceph Grafana Container, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, release=239.1651231664, io.buildah.version=1.32.0, build-date=2022-04-29T11:48:11.055897, com.redhat.component=ubi8-container) 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 bash[65689]: 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 systemd[1]: Started Ceph grafana.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445700766Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.44591838Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445940416Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445947478Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445953983Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445960031Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.44596616Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445975208Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-11T08:19:17.487 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445985866Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.445995332Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.446000841Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.446006257Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.446011986Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=settings t=2024-09-11T08:19:17.446018501Z level=info msg="App mode production" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore t=2024-09-11T08:19:17.446069448Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore t=2024-09-11T08:19:17.446086547Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.446901939Z level=info msg="Starting DB migrations" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.446972677Z level=info msg="Executing migration" id="create migration_log table" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.447521788Z level=info msg="Executing migration" id="create user table" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.44795226Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.448418012Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-11T08:19:17.488 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.448998512Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.449476232Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.449834806Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.450559664Z level=info msg="Executing migration" id="create user table v2" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.450942519Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.451370264Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.451832889Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.454340099Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.454693535Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.457383639Z level=info msg="Executing migration" id="Update user table charset" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.459976102Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.460427274Z level=info msg="Executing migration" id="Add missing user data" 2024-09-11T08:19:17.489 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.460768094Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.46121224Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.461616407Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.462048997Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.463204635Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.463718723Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.466587347Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.469299535Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.469864113Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.472783228Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.475380157Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.477957809Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.480668732Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-11T08:19:17.490 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.483267944Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-11T08:19:17.491 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.485951425Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-11T08:19:17.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:17.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3968579357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T08:19:17.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1016542811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T08:19:17.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:17.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3968579357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T08:19:17.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1016542811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.488667366Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.49124604Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.493971229Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.496904035Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.499417975Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.501998326Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.504616671Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.50515035Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-11T08:19:17.739 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.506139869Z level=info msg="Executing migration" id="create star table" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.506927961Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.50791647Z level=info msg="Executing migration" id="create org table v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.508362001Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.509235764Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.510017537Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.510452112Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.511290691Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.512238451Z level=info msg="Executing migration" id="Update org table charset" 2024-09-11T08:19:17.740 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.512967064Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.51331583Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.514048074Z level=info msg="Executing migration" id="create dashboard table" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.514473659Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.514941712Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.515787138Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.516226473Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.517065477Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.518030752Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.519030439Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.519474767Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.520309941Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-11T08:19:17.741 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.521286939Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.522020621Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.5224634Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.523248855Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.523830085Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.524418451Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.525246047Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.525729687Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-11T08:19:17.742 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.526268344Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.527142459Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.528085252Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.528923012Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.529446238Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.530299929Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.533051654Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.536043027Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-11T08:19:17.744 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.53671231Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.539616269Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.542473186Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.545202221Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.545563842Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.548366519Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.551210279Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.553958467Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-11T08:19:17.745 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.554426102Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.557248349Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.560127911Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.563040982Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.565666043Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.568666305Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.571501598Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.574502661Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.574910787Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.577658422Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.580548718Z level=info msg="Executing migration" id="create data_source table" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.582843485Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.583270186Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.585762522Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-11T08:19:17.746 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.588452694Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.591109546Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.592128274Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.594892675Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.597619103Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.600230877Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.600617446Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.60334743Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.606109861Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.60876965Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.609205288Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.610025404Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.610422095Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-11T08:19:17.747 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.610842515Z level=info msg="Executing migration" id="Add uid column" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.611437098Z level=info msg="Executing migration" id="Update uid value" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.611750062Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.612204151Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.61264852Z level=info msg="Executing migration" id="create api_key table" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.613465927Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.614285408Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.615181057Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.615659933Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.616470096Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.617405339Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.618116395Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.619203619Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-11T08:19:17.748 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.620040473Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.621064592Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.621948274Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.622670528Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.62349401Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.624356519Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.625393017Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.626081467Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.626960891Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.627842929Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.628699505Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.629555306Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-11T08:19:17.749 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.630425457Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.631286391Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.632260049Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.632970028Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.633843665Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.634704628Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.635599598Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.636461366Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.639273411Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.642115186Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-11T08:19:17.750 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.644951293Z level=info msg="Executing migration" id="create quota table v1" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.647608091Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.650423923Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.653204715Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.656030201Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.656469211Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.657071517Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.657384725Z level=info msg="Executing migration" id="create session table" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.657830446Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.658155276Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.658443329Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.658842615Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.659250256Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.659528194Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-11T08:19:17.751 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.65981306Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.660147628Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.660444257Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.660859006Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.661169741Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.661757371Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.66209439Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.662707701Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.663344267Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.663670345Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-11T08:19:17.752 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.664114898Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.664576499Z level=info msg="Executing migration" id="create alert table v1" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.666986306Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.66955623Z level=info msg="Executing migration" id="add index alert state" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.671897699Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.672354176Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.672739595Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.673178618Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.67359419Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-11T08:19:17.753 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.674995035Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.675418422Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.675857659Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.676194825Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.676550588Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.676941466Z level=info msg="Executing migration" id="Add column is_default" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.677600286Z level=info msg="Executing migration" id="Add column frequency" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.678245253Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.678925876Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.679592007Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.68002686Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.680334213Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.680627064Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-11T08:19:17.754 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.68124522Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-11T08:19:17.755 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.681681836Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.682092252Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.684703613Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.687433733Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.68975872Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.690459091Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.691309725Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.69191914Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.692348605Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.69314136Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.693924629Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.694702206Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-11T08:19:17.756 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.695559694Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.696218141Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.696950529Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.697874754Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.698493588Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.699285073Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.699961545Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.700723563Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.701510074Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.702230237Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.702981433Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.70376923Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.704704393Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-11T08:19:17.757 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.705346034Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.706098757Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.707788348Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.708198982Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.708990964Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.709843236Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.710675153Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.711330948Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.712122328Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.712915039Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.713715357Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.714631413Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.715345522Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-11T08:19:17.758 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.716093365Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.716931921Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.719595172Z level=info msg="Executing migration" id="Move region to single row" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.722387549Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.725081873Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.727601456Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.730534558Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.733248118Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.735813357Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.738545703Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-11T08:19:17.759 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.741208575Z level=info msg="Executing migration" id="create test_data table" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.74382136Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.744230825Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.746841079Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.749555605Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.752303624Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-11T08:19:17.989 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.755023601Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.757753404Z level=info msg="Executing migration" id="create team table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.760447206Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.763176276Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.765693342Z level=info msg="Executing migration" id="create team member table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.768169387Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.770740366Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.773079861Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.775683295Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.778152805Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.780633505Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.783132888Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.785754223Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-11T08:19:17.990 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.788349383Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.790833416Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.791311243Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.793790374Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.794217692Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.794624182Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.795043455Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.795432883Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.795702516Z level=info msg="Executing migration" id="create tag table" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.796086926Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.796497037Z level=info msg="Executing migration" id="create login attempt table" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.796868262Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-11T08:19:17.991 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.797297939Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.797658698Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.799561032Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.799939208Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.800374449Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.800657877Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.801097304Z level=info msg="Executing migration" id="create user auth table" 2024-09-11T08:19:17.992 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.801466745Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-11T08:19:17.993 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.801874013Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-11T08:19:17.993 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.802195168Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-11T08:19:17.993 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.802896207Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-11T08:19:17.993 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.803648852Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.804425377Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.805219173Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.805653328Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.806473466Z level=info msg="Executing migration" id="create server_lock table" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.806879077Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.807340815Z level=info msg="Executing migration" id="create user auth token table" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.807769338Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.80826878Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.808710591Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.811589989Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.81459902Z level=info msg="Executing migration" id="create cache_data table" 2024-09-11T08:19:17.994 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.817287499Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.81772425Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.820595992Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.823317736Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.825998886Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.826322909Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.829548442Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.832236394Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.835072511Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.835408952Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.838179679Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.838607097Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.840906279Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-11T08:19:17.995 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.843584643Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.844445886Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.847017374Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.849741675Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.852479111Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.852945485Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.855754699Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.858546627Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.861093668Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.863926113Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.866495932Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.86736507Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.868253289Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.868732622Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-11T08:19:17.996 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.86957303Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.873020173Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.876422234Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.876962251Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.877797681Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.878663897Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.879495447Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.879974201Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.880933836Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.881655305Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.882538336Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.883534688Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.884459367Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.885388719Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-11T08:19:17.997 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.886349775Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.887091635Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.887967471Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.888857969Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.889715821Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.890612747Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.891495955Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.892334656Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.893200549Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.894073385Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.894519411Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.895453614Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.896513081Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.897390248Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.89827628Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.899171261Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-11T08:19:17.998 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.900037058Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.900905236Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.90373341Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.904643134Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.907548297Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.910319713Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.913153684Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.914061029Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.916963504Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.919840283Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.922807765Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.923287598Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.926142697Z level=info msg="Executing migration" id="create alert_image table" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.92877503Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.931660658Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-11T08:19:17.999 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.932021996Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.934781982Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.93768873Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.937799919Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.940479301Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.940889428Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.943428017Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.94359036Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.943723916Z level=info msg="alerts found to migrate" alerts=0 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.946176781Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.949005852Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.949650699Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.952441657Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.955062005Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-11T08:19:18.000 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.957706747Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.958152766Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.960831349Z level=info msg="Executing migration" id="create data_keys table" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.961504689Z level=info msg="Executing migration" id="create secrets table" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.963328482Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.967647012Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.968612089Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.971331182Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.975800624Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.98016128Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.983088399Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.98375649Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.98455903Z level=info msg="Executing migration" id="create permission table" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.985564264Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.986130948Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-11T08:19:18.001 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.987005001Z level=info msg="Executing migration" id="create role table" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.987962459Z level=info msg="Executing migration" id="add column display_name" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.988922039Z level=info msg="Executing migration" id="add column group_name" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.990049219Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.990899807Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.991746422Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-11T08:19:18.002 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.992593771Z level=info msg="Executing migration" id="create team role table" 2024-09-11T08:19:18.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-mon[32813]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:18.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.345 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.993071167Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-11T08:19:18.345 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.993855583Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.994695524Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.995542594Z level=info msg="Executing migration" id="create user role table" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.995997421Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.996835579Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.997720978Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.998603666Z level=info msg="Executing migration" id="create builtin role table" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.999266748Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:17.999993276Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.000840986Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.00194925Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.00245403Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-11T08:19:18.346 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.003319532Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.004293865Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.005044011Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.005480994Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.006449941Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.007520049Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.008404278Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.008876718Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.009826797Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.01072525Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.011463184Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.011826624Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.012155381Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-11T08:19:18.347 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.012488748Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.012878041Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.013313496Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.014268023Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.01460319Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.015027517Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.015436673Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.015843179Z level=info msg="Executing migration" id="add correlation config column" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.016836113Z level=info msg="Executing migration" id="create entity_events table" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.017293699Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.017934482Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.018016625Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.018290906Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-11T08:19:18.348 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.0183651Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.018606206Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.019075165Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.019493359Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.020376001Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.020965137Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.021694616Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.022506583Z level=info msg="Executing migration" id="Drop public config table" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.023293993Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.024058775Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.024523257Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.025323164Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.026080423Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-11T08:19:18.349 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.029071199Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.030085463Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.031100482Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.031904988Z level=info msg="Executing migration" id="add share column" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.032922763Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.033412288Z level=info msg="Executing migration" id="create file table" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.034184959Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.034991907Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.035471605Z level=info msg="Executing migration" id="create file_meta table" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.035917017Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.036579642Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.039424198Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.039857391Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.042194031Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.042641552Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-11T08:19:18.350 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.045477754Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.048013363Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.051014341Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.05147015Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.05406111Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.054461661Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.056775152Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.059413501Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-11T08:19:18.351 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.059967763Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.069737527Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.072432344Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.075089116Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.078740439Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.081427371Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.083951474Z level=info msg="Executing migration" id="create folder table" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.086398216Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.086868618Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.089303198Z level=info msg="Executing migration" id="Update folder title length" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.091601437Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=migrator t=2024-09-11T08:19:18.094355971Z level=info msg="migrations completed" performed=485 skipped=0 duration=647.401189ms 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore t=2024-09-11T08:19:18.0947515Z level=info msg="Created default organization" 2024-09-11T08:19:18.352 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=plugin.loader t=2024-09-11T08:19:18.149377005Z level=info msg="Plugin registered" pluginID=input 2024-09-11T08:19:18.353 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=plugin.loader t=2024-09-11T08:19:18.17587155Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-09-11T08:19:18.353 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=plugin.loader t=2024-09-11T08:19:18.175891131Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-09-11T08:19:18.353 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=secrets t=2024-09-11T08:19:18.175923106Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-11T08:19:18.353 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=query_data t=2024-09-11T08:19:18.177590646Z level=info msg="Query Service initialization" 2024-09-11T08:19:18.353 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=live.push_http t=2024-09-11T08:19:18.180145088Z level=info msg="Live Push Gateway initialization" 2024-09-11T08:19:18.605 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[40835]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:18.605 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.605 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.605 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.605 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.606 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[29664]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:18.606 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.606 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.606 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.606 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:18 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 -- 172.21.15.173:0/3546246522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 msgr2=0x7fd128102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 --2- 172.21.15.173:0/3546246522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd128102c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd118004950 tx=0x7fd118009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 -- 172.21.15.173:0/3546246522 shutdown_connections 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 --2- 172.21.15.173:0/3546246522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 0x7fd128109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 --2- 172.21.15.173:0/3546246522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd1280663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 --2- 172.21.15.173:0/3546246522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd128102c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 -- 172.21.15.173:0/3546246522 >> 172.21.15.173:0/3546246522 conn(0x7fd128072510 msgr2=0x7fd128072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 -- 172.21.15.173:0/3546246522 shutdown_connections 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 -- 172.21.15.173:0/3546246522 wait complete. 2024-09-11T08:19:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.559+0000 7fd12e254640 1 Processor -- start 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 -- start start 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 0x7fd128113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd12810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12810d3d0 con 0x7fd128065f80 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12810d540 con 0x7fd1280668f0 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd12e254640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12810d700 con 0x7fd1281028c0 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49254/0 (socket says 172.21.15.173:49254) 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd127fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd12810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 -- 172.21.15.173:0/3968579357 learned_addr learned my addr 172.21.15.173:0/3968579357 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd126ffd640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 0x7fd128113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 -- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 msgr2=0x7fd12810cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd12810cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 -- 172.21.15.173:0/3968579357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 msgr2=0x7fd128113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 0x7fd128113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 -- 172.21.15.173:0/3968579357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c005040 con 0x7fd128065f80 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stdout:158913789981 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd127fff640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd12810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:18.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.560+0000 7fd1277fe640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd118009040 tx=0x7fd118035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.561+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118009530 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.561+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fd118033860 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.561+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118005040 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.561+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11803c620 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.561+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd128119a40 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.562+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1280fdfa0 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.562+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fd118030020 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.563+0000 7fd10ffff640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 0x7fd1100713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.563+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7fd1180aeb50 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.563+0000 7fd126ffd640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 0x7fd1100713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.563+0000 7fd126ffd640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 0x7fd1100713c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd12810e4b0 tx=0x7fd11c00b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.567+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd11807b600 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.734+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd12810baf0 con 0x7fd128065f80 2024-09-11T08:19:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.734+0000 7fd10ffff640 1 -- 172.21.15.173:0/3968579357 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd11807afa0 con 0x7fd128065f80 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 msgr2=0x7fd1100713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 0x7fd1100713c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd12810e4b0 tx=0x7fd11c00b040 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 msgr2=0x7fd128112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd118009040 tx=0x7fd118035040 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 shutdown_connections 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fd11006ef10 0x7fd1100713c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1281028c0 0x7fd12810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1280668f0 0x7fd128113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 --2- 172.21.15.173:0/3968579357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd128065f80 0x7fd128112bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 >> 172.21.15.173:0/3968579357 conn(0x7fd128072510 msgr2=0x7fd1280fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:18.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 shutdown_connections 2024-09-11T08:19:18.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:16.737+0000 7fd12e254640 1 -- 172.21.15.173:0/3968579357 wait complete. 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=infra.usagestats.collector t=2024-09-11T08:19:18.898065001Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=provisioning.datasources t=2024-09-11T08:19:18.89836772Z level=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=provisioning.datasources t=2024-09-11T08:19:18.932245658Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=provisioning.datasources t=2024-09-11T08:19:18.963632111Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=provisioning.alerting t=2024-09-11T08:19:18.985428433Z level=info msg="starting to provision alerting" 2024-09-11T08:19:19.241 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=provisioning.alerting t=2024-09-11T08:19:18.985464569Z level=info msg="finished to provision alerting" 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=ngalert.state.manager t=2024-09-11T08:19:18.98561963Z level=info msg="Warming state cache for startup" 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=grafanaStorageLogger t=2024-09-11T08:19:18.985659537Z level=info msg="storage starting" 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=http.server t=2024-09-11T08:19:18.987364936Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=ngalert.state.manager t=2024-09-11T08:19:18.995802462Z level=info msg="State cache has been initialized" states=0 duration=10.179654ms 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=ngalert.multiorg.alertmanager t=2024-09-11T08:19:18.995853842Z level=info msg="starting MultiOrg Alertmanager" 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=ticker t=2024-09-11T08:19:18.995884749Z level=info msg=starting first_tick=2024-09-11T08:19:20Z 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore.transactions t=2024-09-11T08:19:18.996389231Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-11T08:19:19.242 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:19:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore.transactions t=2024-09-11T08:19:19.006786906Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-11T08:19:19.359 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:19 smithi173 ceph-mon[29664]: Deploying daemon node-exporter.a on smithi173 2024-09-11T08:19:19.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:19 smithi173 ceph-mon[40835]: Deploying daemon node-exporter.a on smithi173 2024-09-11T08:19:19.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:19 smithi175 ceph-mon[32813]: Deploying daemon node-exporter.a on smithi173 2024-09-11T08:19:19.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789979 got 158913789981 for osd.5 2024-09-11T08:19:19.738 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 -- 172.21.15.173:0/4219546374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c0fb800 msgr2=0x7ffa2c0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 --2- 172.21.15.173:0/4219546374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c0fb800 0x7ffa2c0fbc70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004980 tx=0x7ffa28009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 -- 172.21.15.173:0/4219546374 shutdown_connections 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 --2- 172.21.15.173:0/4219546374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 --2- 172.21.15.173:0/4219546374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c0fb800 0x7ffa2c0fbc70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 --2- 172.21.15.173:0/4219546374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c1017d0 0x7ffa2c101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 -- 172.21.15.173:0/4219546374 >> 172.21.15.173:0/4219546374 conn(0x7ffa2c071c00 msgr2=0x7ffa2c072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 -- 172.21.15.173:0/4219546374 shutdown_connections 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.366+0000 7ffa33305640 1 -- 172.21.15.173:0/4219546374 wait complete. 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 Processor -- start 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 -- start start 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 0x7ffa2c10ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c1017d0 0x7ffa2c10e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c119000 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c119170 con 0x7ffa2c0fb800 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa33305640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c119330 con 0x7ffa2c1017d0 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49292/0 (socket says 172.21.15.173:49292) 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 -- 172.21.15.173:0/378683428 learned_addr learned my addr 172.21.15.173:0/378683428 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa318a2640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c1017d0 0x7ffa2c10e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa310a1640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 0x7ffa2c10ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 -- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c1017d0 msgr2=0x7ffa2c10e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c1017d0 0x7ffa2c10e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 -- 172.21.15.173:0/378683428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 msgr2=0x7ffa2c10ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.367+0000 7ffa308a0640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 0x7ffa2c10ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa308a0640 1 -- 172.21.15.173:0/378683428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240098b0 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa310a1640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 0x7ffa2c10ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa308a0640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa2802a580 tx=0x7ffa28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28009500 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa28005040 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7ffa28033860 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2803b5f0 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.368+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c1199c0 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.369+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c0fcef0 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.370+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7ffa28030020 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.370+0000 7ffa1dffb640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 0x7ffa180713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.370+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7ffa280ae190 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.370+0000 7ffa310a1640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 0x7ffa180713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.371+0000 7ffa310a1640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 0x7ffa180713c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa20004c60 tx=0x7ffa20009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.378+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffa2807ad20 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.407 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[29664]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:20.407 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:20.408 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:20.408 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[40835]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:20.408 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:20.408 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:20.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:20 smithi175 ceph-mon[32813]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:20.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:20.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.557+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffa2c119520 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.558+0000 7ffa1dffb640 1 -- 172.21.15.173:0/378683428 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa2807a6c0 con 0x7ffa2c0fc1b0 2024-09-11T08:19:20.559 INFO:teuthology.orchestra.run.smithi173.stdout:184683593753 2024-09-11T08:19:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 msgr2=0x7ffa180713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 0x7ffa180713c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa20004c60 tx=0x7ffa20009040 comp rx=0 tx=0).stop 2024-09-11T08:19:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 msgr2=0x7ffa2c10e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa2802a580 tx=0x7ffa28009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 shutdown_connections 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ffa1806ef10 0x7ffa180713c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c1017d0 0x7ffa2c10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c0fc1b0 0x7ffa2c10e310 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 --2- 172.21.15.173:0/378683428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa2c0fb800 0x7ffa2c10ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 >> 172.21.15.173:0/378683428 conn(0x7ffa2c071c00 msgr2=0x7ffa2c0fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 shutdown_connections 2024-09-11T08:19:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:20.560+0000 7ffa33305640 1 -- 172.21.15.173:0/378683428 wait complete. 2024-09-11T08:19:20.675 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:20 smithi173 systemd[1]: Starting Ceph node-exporter.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:19:21.360 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/378683428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T08:19:21.361 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/378683428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T08:19:21.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593749 got 184683593753 for osd.6 2024-09-11T08:19:21.390 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:21.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/378683428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T08:19:22.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986207 got 133143986210 for osd.4 2024-09-11T08:19:22.261 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:22.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 -- 172.21.15.173:0/4093821297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 msgr2=0x7f21cc101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 --2- 172.21.15.173:0/4093821297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc101ba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21bc004980 tx=0x7f21bc009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 -- 172.21.15.173:0/4093821297 shutdown_connections 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 --2- 172.21.15.173:0/4093821297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 0x7f21cc108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 --2- 172.21.15.173:0/4093821297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 --2- 172.21.15.173:0/4093821297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc101ba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 -- 172.21.15.173:0/4093821297 >> 172.21.15.173:0/4093821297 conn(0x7f21cc071c00 msgr2=0x7f21cc072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 -- 172.21.15.173:0/4093821297 shutdown_connections 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 -- 172.21.15.173:0/4093821297 wait complete. 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.451+0000 7f21d2485640 1 Processor -- start 2024-09-11T08:19:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 -- start start 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 0x7f21cc1130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc10cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc10d390 con 0x7f21cc0fb800 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc10d500 con 0x7f21cc0fc1b0 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d2485640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc10d6c0 con 0x7f21cc1017d0 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58520/0 (socket says 172.21.15.173:58520) 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d0a22640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc10cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 -- 172.21.15.173:0/3998094541 learned_addr learned my addr 172.21.15.173:0/3998094541 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cb7fe640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 0x7f21cc1130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:22.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 -- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 msgr2=0x7f21cc10cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc10cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 -- 172.21.15.173:0/3998094541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 msgr2=0x7f21cc1130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 0x7f21cc1130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21cbfff640 1 -- 172.21.15.173:0/3998094541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21cc0fb800 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.452+0000 7f21d0a22640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21cbfff640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21bc02d040 tx=0x7f21bc035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02aca0 con 0x7f21cc0fb800 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f21bc02ae00 con 0x7f21cc0fb800 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc005040 con 0x7f21cc0fb800 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc03c410 con 0x7f21cc0fb800 2024-09-11T08:19:22.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.453+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc119a00 con 0x7f21cc0fb800 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.454+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0fcef0 con 0x7f21cc0fb800 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.454+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f21bc030020 con 0x7f21cc0fb800 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.455+0000 7f21c8ff9640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 0x7f21b40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.455+0000 7f21cb7fe640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 0x7f21b40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.455+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f21bc0ae5d0 con 0x7f21cc0fb800 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.455+0000 7f21cb7fe640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 0x7f21b40713c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21cc10e470 tx=0x7f21c000b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:22.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.459+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f21bc07b220 con 0x7f21cc0fb800 2024-09-11T08:19:22.489 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:22 smithi173 ceph-mon[29664]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:22.490 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:22 smithi173 ceph-mon[40835]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:22 smithi175 ceph-mon[32813]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:22.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.622+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21cc10aa90 con 0x7f21cc0fb800 2024-09-11T08:19:22.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.622+0000 7f21c8ff9640 1 -- 172.21.15.173:0/3998094541 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21bc07abc0 con 0x7f21cc0fb800 2024-09-11T08:19:22.624 INFO:teuthology.orchestra.run.smithi173.stdout:34359738422 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 msgr2=0x7f21b40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 0x7f21b40713c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21cc10e470 tx=0x7f21c000b040 comp rx=0 tx=0).stop 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 msgr2=0x7f21cc112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21bc02d040 tx=0x7f21bc035040 comp rx=0 tx=0).stop 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 shutdown_connections 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f21b406ef10 0x7f21b40713c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21cc1017d0 0x7f21cc10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21cc0fc1b0 0x7f21cc1130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 --2- 172.21.15.173:0/3998094541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21cc0fb800 0x7f21cc112bb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 >> 172.21.15.173:0/3998094541 conn(0x7f21cc071c00 msgr2=0x7f21cc0653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 shutdown_connections 2024-09-11T08:19:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:22.624+0000 7f21d2485640 1 -- 172.21.15.173:0/3998094541 wait complete. 2024-09-11T08:19:23.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738418 got 34359738422 for osd.0 2024-09-11T08:19:23.321 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:23.591 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3998094541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T08:19:23.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3998094541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T08:19:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3998094541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T08:19:23.870 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:23 smithi173 bash[77155]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.064+0000 7f16043c1640 1 -- 172.21.15.173:0/983632706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc1028c0 msgr2=0x7f15fc102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.064+0000 7f16043c1640 1 --2- 172.21.15.173:0/983632706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc1028c0 0x7f15fc102c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15ec004980 tx=0x7f15ec009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- 172.21.15.173:0/983632706 shutdown_connections 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- 172.21.15.173:0/983632706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fd250 0x7f15fc109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- 172.21.15.173:0/983632706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc0fc8a0 0x7f15fc0fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- 172.21.15.173:0/983632706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc1028c0 0x7f15fc102c90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- 172.21.15.173:0/983632706 >> 172.21.15.173:0/983632706 conn(0x7f15fc0f8400 msgr2=0x7f15fc0fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- 172.21.15.173:0/983632706 shutdown_connections 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- 172.21.15.173:0/983632706 wait complete. 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 Processor -- start 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- start start 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc1028c0 0x7f15fc10cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d3f0 con 0x7f15fc0fd250 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d560 con 0x7f15fc1028c0 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f16043c1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d720 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f160195c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f160215d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f160195c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58542/0 (socket says 172.21.15.173:58542) 2024-09-11T08:19:24.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f160195c640 1 -- 172.21.15.173:0/4162369839 learned_addr learned my addr 172.21.15.173:0/4162369839 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.065+0000 7f160215d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:56658/0 (socket says 172.21.15.173:56658) 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160295e640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc1028c0 0x7f15fc10cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 -- 172.21.15.173:0/4162369839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc1028c0 msgr2=0x7f15fc10cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc1028c0 0x7f15fc10cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 -- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 msgr2=0x7f15fc113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 -- 172.21.15.173:0/4162369839 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40098b0 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160195c640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f160215d640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02d040 tx=0x7f15ec035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec02ab50 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f15ec02acb0 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec005040 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec03c410 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.066+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc119a60 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.067+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc0fdfe0 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.068+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f15ec030020 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.068+0000 7f15f2ffd640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 0x7f15e80713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.068+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f15ec0ae3b0 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.068+0000 7f160195c640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 0x7f15e80713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.069+0000 7f160195c640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 0x7f15e80713c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15f8004fd0 tx=0x7f15f8009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.072+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f15ec07ae70 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.216 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:24 smithi173 bash[77155]: Getting image source signatures 2024-09-11T08:19:24.216 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:24 smithi173 bash[77155]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-11T08:19:24.217 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:24 smithi173 bash[77155]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-11T08:19:24.217 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:24 smithi173 bash[77155]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-11T08:19:24.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.236+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f15fc10bb80 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.236+0000 7f15f2ffd640 1 -- 172.21.15.173:0/4162369839 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15ec07a810 con 0x7f15fc0fc8a0 2024-09-11T08:19:24.237 INFO:teuthology.orchestra.run.smithi173.stdout:210453397525 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 msgr2=0x7f15e80713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 0x7f15e80713c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15f8004fd0 tx=0x7f15f8009040 comp rx=0 tx=0).stop 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 msgr2=0x7f15fc112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02d040 tx=0x7f15ec035040 comp rx=0 tx=0).stop 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 shutdown_connections 2024-09-11T08:19:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f15e806ef10 0x7f15e80713c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15fc1028c0 0x7f15fc10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15fc0fd250 0x7f15fc113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 --2- 172.21.15.173:0/4162369839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15fc0fc8a0 0x7f15fc112c10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 >> 172.21.15.173:0/4162369839 conn(0x7f15fc0f8400 msgr2=0x7f15fc0f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 shutdown_connections 2024-09-11T08:19:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:24.238+0000 7f16043c1640 1 -- 172.21.15.173:0/4162369839 wait complete. 2024-09-11T08:19:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:24 smithi175 ceph-mon[32813]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4162369839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T08:19:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:24 smithi173 ceph-mon[29664]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4162369839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T08:19:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:24 smithi173 ceph-mon[40835]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4162369839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T08:19:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:25.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397520 got 210453397525 for osd.7 2024-09-11T08:19:25.717 DEBUG:teuthology.parallel:result is None 2024-09-11T08:19:25.718 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T08:19:25.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T08:19:25.966 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:25 smithi173 bash[77155]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-11T08:19:25.967 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:25 smithi173 bash[77155]: Writing manifest to image destination 2024-09-11T08:19:26.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:26.458 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-mon[29664]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:26.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-mon[40835]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:26.458 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 podman[77155]: 2024-09-11 08:19:26.140456455 +0000 UTC m=+2.496962457 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-11T08:19:26.458 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 podman[77155]: 2024-09-11 08:19:26.230403594 +0000 UTC m=+2.586909588 container create 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:26.458 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 podman[77155]: 2024-09-11 08:19:26.457985065 +0000 UTC m=+2.814491076 container init 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:26.555 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:26 smithi175 ceph-mon[32813]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:26.710 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 podman[77155]: 2024-09-11 08:19:26.46339201 +0000 UTC m=+2.819898005 container start 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:26.710 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.467Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-11T08:19:26.710 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.467Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-11T08:19:26.710 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.467Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-11T08:19:26.710 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.467Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=arp 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.468Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-11T08:19:26.711 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=edac 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-11T08:19:26.712 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=os 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-11T08:19:26.713 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=stat 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=time 2024-09-11T08:19:26.714 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=uname 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a[77367]: ts=2024-09-11T08:19:26.469Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 bash[77155]: 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 2024-09-11T08:19:26.715 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:19:26 smithi173 systemd[1]: Started Ceph node-exporter.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:27 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:27 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:27 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.595 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:27 smithi175 bash[65986]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:27 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:28.265 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:27 smithi175 bash[65986]: Getting image source signatures 2024-09-11T08:19:28.265 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:27 smithi175 bash[65986]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-11T08:19:28.265 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:27 smithi175 bash[65986]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-11T08:19:28.265 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:27 smithi175 bash[65986]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 -- 172.21.15.173:0/2350822043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 msgr2=0x7f85f8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 --2- 172.21.15.173:0/2350822043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8108580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d50 tx=0x7f85f0004c50 comp rx=0 tx=0).stop 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 -- 172.21.15.173:0/2350822043 shutdown_connections 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 --2- 172.21.15.173:0/2350822043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8108580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 --2- 172.21.15.173:0/2350822043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f80fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 --2- 172.21.15.173:0/2350822043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 0x7f85f8101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 -- 172.21.15.173:0/2350822043 >> 172.21.15.173:0/2350822043 conn(0x7f85f8071c00 msgr2=0x7f85f8072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 -- 172.21.15.173:0/2350822043 shutdown_connections 2024-09-11T08:19:28.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.238+0000 7f86007ef640 1 -- 172.21.15.173:0/2350822043 wait complete. 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 Processor -- start 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 -- start start 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 0x7f85f81099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f811afa0 con 0x7f85f80fc1b0 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f811b110 con 0x7f85f81017d0 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f86007ef640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f811b2d0 con 0x7f85f80fb800 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fe58b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:28.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58564/0 (socket says 172.21.15.173:58564) 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 -- 172.21.15.173:0/1482986329 learned_addr learned my addr 172.21.15.173:0/1482986329 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fed8c640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 0x7f85f81099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 -- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 msgr2=0x7f85f8108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f8108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 -- 172.21.15.173:0/1482986329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 msgr2=0x7f85f81099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 0x7f85f81099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 -- 172.21.15.173:0/1482986329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4005040 con 0x7f85f80fc1b0 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fe58b640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.239+0000 7f85fdd8a640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009550 tx=0x7f85f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.240+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400e930 con 0x7f85f80fc1b0 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.240+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f85f400f040 con 0x7f85f80fc1b0 2024-09-11T08:19:28.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.240+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4013b10 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.240+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f00098b0 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.240+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f811b970 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.241+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80fcef0 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.241+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f85f400ea90 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.242+0000 7f85eeffd640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 0x7f85e40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.242+0000 7f85fe58b640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 0x7f85e40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.242+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f85f408e730 con 0x7f85f80fc1b0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.242+0000 7f85fe58b640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 0x7f85e40713c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85e8004fd0 tx=0x7f85e800b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:28.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.246+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f85f405b1e0 con 0x7f85f80fc1b0 2024-09-11T08:19:28.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.401+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 --> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85f810a4a0 con 0x7f85e406ef10 2024-09-11T08:19:28.404 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:28 smithi173 ceph-mon[29664]: Deploying daemon node-exporter.b on smithi175 2024-09-11T08:19:28.404 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:28 smithi173 ceph-mon[29664]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:28.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:28 smithi173 ceph-mon[40835]: Deploying daemon node-exporter.b on smithi175 2024-09-11T08:19:28.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:28 smithi173 ceph-mon[40835]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:28.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.412+0000 7f85eeffd640 1 -- 172.21.15.173:0/1482986329 <== mgr.14556 v2:172.21.15.173:6800/2824501820 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+384079 (secure 0 0 0) 0x7f85f810a4a0 con 0x7f85e406ef10 2024-09-11T08:19:28.416 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:19:28.418 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 msgr2=0x7f85e40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 0x7f85e40713c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85e8004fd0 tx=0x7f85e800b040 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 msgr2=0x7f85f8109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009550 tx=0x7f85f4009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 shutdown_connections 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f85e406ef10 0x7f85e40713c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f81017d0 0x7f85f81099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85f80fc1b0 0x7f85f8109490 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 --2- 172.21.15.173:0/1482986329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85f80fb800 0x7f85f8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 >> 172.21.15.173:0/1482986329 conn(0x7f85f8071c00 msgr2=0x7f85f80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 shutdown_connections 2024-09-11T08:19:28.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:28.415+0000 7f86007ef640 1 -- 172.21.15.173:0/1482986329 wait complete. 2024-09-11T08:19:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:28 smithi175 ceph-mon[32813]: Deploying daemon node-exporter.b on smithi175 2024-09-11T08:19:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:28 smithi175 ceph-mon[32813]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:29.142 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-11T08:19:26.710699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596188,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":933,"num_read_kb":790,"num_write":543,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":548,"ondisk_log_size":548,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2385924,"kb_used_data":7088,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":747575292,"statfs":{"total":767960285184,"available":765517099008,"internally_reserved":0,"allocated":7258112,"data_stored":4014380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002677"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076531+0000","last_change":"2024-09-11T08:18:04.443964+0000","last_active":"2024-09-11T08:18:09.076531+0000","last_peered":"2024-09-11T08:18:09.076531+0000","last_clean":"2024-09-11T08:18:09.076531+0000","last_became_active":"2024-09-11T08:18:04.443685+0000","last_became_peered":"2024-09-11T08:18:04.443685+0000","last_unstale":"2024-09-11T08:18:09.076531+0000","last_undegraded":"2024-09-11T08:18:09.076531+0000","last_fullsized":"2024-09-11T08:18:09.076531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:52.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748361+0000","last_change":"2024-09-11T08:17:58.366730+0000","last_active":"2024-09-11T08:18:08.748361+0000","last_peered":"2024-09-11T08:18:08.748361+0000","last_clean":"2024-09-11T08:18:08.748361+0000","last_became_active":"2024-09-11T08:17:58.366441+0000","last_became_peered":"2024-09-11T08:17:58.366441+0000","last_unstale":"2024-09-11T08:18:08.748361+0000","last_undegraded":"2024-09-11T08:18:08.748361+0000","last_fullsized":"2024-09-11T08:18:08.748361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:31.697163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077044+0000","last_change":"2024-09-11T08:18:00.384684+0000","last_active":"2024-09-11T08:18:09.077044+0000","last_peered":"2024-09-11T08:18:09.077044+0000","last_clean":"2024-09-11T08:18:09.077044+0000","last_became_active":"2024-09-11T08:18:00.384300+0000","last_became_peered":"2024-09-11T08:18:00.384300+0000","last_unstale":"2024-09-11T08:18:09.077044+0000","last_undegraded":"2024-09-11T08:18:09.077044+0000","last_fullsized":"2024-09-11T08:18:09.077044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:40.768400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743289+0000","last_change":"2024-09-11T08:18:02.391581+0000","last_active":"2024-09-11T08:18:08.743289+0000","last_peered":"2024-09-11T08:18:08.743289+0000","last_clean":"2024-09-11T08:18:08.743289+0000","last_became_active":"2024-09-11T08:18:02.391203+0000","last_became_peered":"2024-09-11T08:18:02.391203+0000","last_unstale":"2024-09-11T08:18:08.743289+0000","last_undegraded":"2024-09-11T08:18:08.743289+0000","last_fullsized":"2024-09-11T08:18:08.743289+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:02.456323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077232+0000","last_change":"2024-09-11T08:17:58.365401+0000","last_active":"2024-09-11T08:18:09.077232+0000","last_peered":"2024-09-11T08:18:09.077232+0000","last_clean":"2024-09-11T08:18:09.077232+0000","last_became_active":"2024-09-11T08:17:58.365112+0000","last_became_peered":"2024-09-11T08:17:58.365112+0000","last_unstale":"2024-09-11T08:18:09.077232+0000","last_undegraded":"2024-09-11T08:18:09.077232+0000","last_fullsized":"2024-09-11T08:18:09.077232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:16:23.037779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743299+0000","last_change":"2024-09-11T08:18:00.379340+0000","last_active":"2024-09-11T08:18:08.743299+0000","last_peered":"2024-09-11T08:18:08.743299+0000","last_clean":"2024-09-11T08:18:08.743299+0000","last_became_active":"2024-09-11T08:18:00.378999+0000","last_became_peered":"2024-09-11T08:18:00.378999+0000","last_unstale":"2024-09-11T08:18:08.743299+0000","last_undegraded":"2024-09-11T08:18:08.743299+0000","last_fullsized":"2024-09-11T08:18:08.743299+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:28.134385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472123+0000","last_change":"2024-09-11T08:18:02.392358+0000","last_active":"2024-09-11T08:18:09.472123+0000","last_peered":"2024-09-11T08:18:09.472123+0000","last_clean":"2024-09-11T08:18:09.472123+0000","last_became_active":"2024-09-11T08:18:02.392050+0000","last_became_peered":"2024-09-11T08:18:02.392050+0000","last_unstale":"2024-09-11T08:18:09.472123+0000","last_undegraded":"2024-09-11T08:18:09.472123+0000","last_fullsized":"2024-09-11T08:18:09.472123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:00.106926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743349+0000","last_change":"2024-09-11T08:18:04.409519+0000","last_active":"2024-09-11T08:18:08.743349+0000","last_peered":"2024-09-11T08:18:08.743349+0000","last_clean":"2024-09-11T08:18:08.743349+0000","last_became_active":"2024-09-11T08:18:04.409278+0000","last_became_peered":"2024-09-11T08:18:04.409278+0000","last_unstale":"2024-09-11T08:18:08.743349+0000","last_undegraded":"2024-09-11T08:18:08.743349+0000","last_fullsized":"2024-09-11T08:18:08.743349+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:52.241128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472799+0000","last_change":"2024-09-11T08:17:58.365437+0000","last_active":"2024-09-11T08:18:09.472799+0000","last_peered":"2024-09-11T08:18:09.472799+0000","last_clean":"2024-09-11T08:18:09.472799+0000","last_became_active":"2024-09-11T08:17:58.365179+0000","last_became_peered":"2024-09-11T08:17:58.365179+0000","last_unstale":"2024-09-11T08:18:09.472799+0000","last_undegraded":"2024-09-11T08:18:09.472799+0000","last_fullsized":"2024-09-11T08:18:09.472799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:56.731980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'5","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743544+0000","last_change":"2024-09-11T08:18:00.379507+0000","last_active":"2024-09-11T08:18:08.743544+0000","last_peered":"2024-09-11T08:18:08.743544+0000","last_clean":"2024-09-11T08:18:08.743544+0000","last_became_active":"2024-09-11T08:18:00.379085+0000","last_became_peered":"2024-09-11T08:18:00.379085+0000","last_unstale":"2024-09-11T08:18:08.743544+0000","last_undegraded":"2024-09-11T08:18:08.743544+0000","last_fullsized":"2024-09-11T08:18:08.743544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:53:02.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472212+0000","last_change":"2024-09-11T08:18:02.388936+0000","last_active":"2024-09-11T08:18:09.472212+0000","last_peered":"2024-09-11T08:18:09.472212+0000","last_clean":"2024-09-11T08:18:09.472212+0000","last_became_active":"2024-09-11T08:18:02.388654+0000","last_became_peered":"2024-09-11T08:18:02.388654+0000","last_unstale":"2024-09-11T08:18:09.472212+0000","last_undegraded":"2024-09-11T08:18:09.472212+0000","last_fullsized":"2024-09-11T08:18:09.472212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:44:50.143199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471304+0000","last_change":"2024-09-11T08:18:04.415319+0000","last_active":"2024-09-11T08:18:09.471304+0000","last_peered":"2024-09-11T08:18:09.471304+0000","last_clean":"2024-09-11T08:18:09.471304+0000","last_became_active":"2024-09-11T08:18:04.415019+0000","last_became_peered":"2024-09-11T08:18:04.415019+0000","last_unstale":"2024-09-11T08:18:09.471304+0000","last_undegraded":"2024-09-11T08:18:09.471304+0000","last_fullsized":"2024-09-11T08:18:09.471304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:12.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472492+0000","last_change":"2024-09-11T08:17:58.360969+0000","last_active":"2024-09-11T08:18:09.472492+0000","last_peered":"2024-09-11T08:18:09.472492+0000","last_clean":"2024-09-11T08:18:09.472492+0000","last_became_active":"2024-09-11T08:17:58.360256+0000","last_became_peered":"2024-09-11T08:17:58.360256+0000","last_unstale":"2024-09-11T08:18:09.472492+0000","last_undegraded":"2024-09-11T08:18:09.472492+0000","last_fullsized":"2024-09-11T08:18:09.472492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:25.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743566+0000","last_change":"2024-09-11T08:18:00.382068+0000","last_active":"2024-09-11T08:18:08.743566+0000","last_peered":"2024-09-11T08:18:08.743566+0000","last_clean":"2024-09-11T08:18:08.743566+0000","last_became_active":"2024-09-11T08:18:00.381710+0000","last_became_peered":"2024-09-11T08:18:00.381710+0000","last_unstale":"2024-09-11T08:18:08.743566+0000","last_undegraded":"2024-09-11T08:18:08.743566+0000","last_fullsized":"2024-09-11T08:18:08.743566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:57.386855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471608+0000","last_change":"2024-09-11T08:18:02.392616+0000","last_active":"2024-09-11T08:18:09.471608+0000","last_peered":"2024-09-11T08:18:09.471608+0000","last_clean":"2024-09-11T08:18:09.471608+0000","last_became_active":"2024-09-11T08:18:02.392303+0000","last_became_peered":"2024-09-11T08:18:02.392303+0000","last_unstale":"2024-09-11T08:18:09.471608+0000","last_undegraded":"2024-09-11T08:18:09.471608+0000","last_fullsized":"2024-09-11T08:18:09.471608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:52.481460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747432+0000","last_change":"2024-09-11T08:18:04.414748+0000","last_active":"2024-09-11T08:18:08.747432+0000","last_peered":"2024-09-11T08:18:08.747432+0000","last_clean":"2024-09-11T08:18:08.747432+0000","last_became_active":"2024-09-11T08:18:04.414467+0000","last_became_peered":"2024-09-11T08:18:04.414467+0000","last_unstale":"2024-09-11T08:18:08.747432+0000","last_undegraded":"2024-09-11T08:18:08.747432+0000","last_fullsized":"2024-09-11T08:18:08.747432+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:23.110007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":44,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743938+0000","last_change":"2024-09-11T08:18:00.379467+0000","last_active":"2024-09-11T08:18:08.743938+0000","last_peered":"2024-09-11T08:18:08.743938+0000","last_clean":"2024-09-11T08:18:08.743938+0000","last_became_active":"2024-09-11T08:18:00.379173+0000","last_became_peered":"2024-09-11T08:18:00.379173+0000","last_unstale":"2024-09-11T08:18:08.743938+0000","last_undegraded":"2024-09-11T08:18:08.743938+0000","last_fullsized":"2024-09-11T08:18:08.743938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:57.452722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472126+0000","last_change":"2024-09-11T08:17:58.358144+0000","last_active":"2024-09-11T08:18:09.472126+0000","last_peered":"2024-09-11T08:18:09.472126+0000","last_clean":"2024-09-11T08:18:09.472126+0000","last_became_active":"2024-09-11T08:17:58.357703+0000","last_became_peered":"2024-09-11T08:17:58.357703+0000","last_unstale":"2024-09-11T08:18:09.472126+0000","last_undegraded":"2024-09-11T08:18:09.472126+0000","last_fullsized":"2024-09-11T08:18:09.472126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472363+0000","last_change":"2024-09-11T08:18:02.391460+0000","last_active":"2024-09-11T08:18:09.472363+0000","last_peered":"2024-09-11T08:18:09.472363+0000","last_clean":"2024-09-11T08:18:09.472363+0000","last_became_active":"2024-09-11T08:18:02.391155+0000","last_became_peered":"2024-09-11T08:18:02.391155+0000","last_unstale":"2024-09-11T08:18:09.472363+0000","last_undegraded":"2024-09-11T08:18:09.472363+0000","last_fullsized":"2024-09-11T08:18:09.472363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:16.898774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472141+0000","last_change":"2024-09-11T08:18:04.413386+0000","last_active":"2024-09-11T08:18:09.472141+0000","last_peered":"2024-09-11T08:18:09.472141+0000","last_clean":"2024-09-11T08:18:09.472141+0000","last_became_active":"2024-09-11T08:18:04.413121+0000","last_became_peered":"2024-09-11T08:18:04.413121+0000","last_unstale":"2024-09-11T08:18:09.472141+0000","last_undegraded":"2024-09-11T08:18:09.472141+0000","last_fullsized":"2024-09-11T08:18:09.472141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:14.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743719+0000","last_change":"2024-09-11T08:18:00.382153+0000","last_active":"2024-09-11T08:18:08.743719+0000","last_peered":"2024-09-11T08:18:08.743719+0000","last_clean":"2024-09-11T08:18:08.743719+0000","last_became_active":"2024-09-11T08:18:00.381827+0000","last_became_peered":"2024-09-11T08:18:00.381827+0000","last_unstale":"2024-09-11T08:18:08.743719+0000","last_undegraded":"2024-09-11T08:18:08.743719+0000","last_fullsized":"2024-09-11T08:18:08.743719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:33.588014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"53'1","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472907+0000","last_change":"2024-09-11T08:17:58.359805+0000","last_active":"2024-09-11T08:18:09.472907+0000","last_peered":"2024-09-11T08:18:09.472907+0000","last_clean":"2024-09-11T08:18:09.472907+0000","last_became_active":"2024-09-11T08:17:58.359501+0000","last_became_peered":"2024-09-11T08:17:58.359501+0000","last_unstale":"2024-09-11T08:18:09.472907+0000","last_undegraded":"2024-09-11T08:18:09.472907+0000","last_fullsized":"2024-09-11T08:18:09.472907+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:52.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459470+0000","last_change":"2024-09-11T08:18:02.389844+0000","last_active":"2024-09-11T08:19:16.459470+0000","last_peered":"2024-09-11T08:19:16.459470+0000","last_clean":"2024-09-11T08:19:16.459470+0000","last_became_active":"2024-09-11T08:18:02.389553+0000","last_became_peered":"2024-09-11T08:18:02.389553+0000","last_unstale":"2024-09-11T08:19:16.459470+0000","last_undegraded":"2024-09-11T08:19:16.459470+0000","last_fullsized":"2024-09-11T08:19:16.459470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:59.216806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743806+0000","last_change":"2024-09-11T08:18:04.409514+0000","last_active":"2024-09-11T08:18:08.743806+0000","last_peered":"2024-09-11T08:18:08.743806+0000","last_clean":"2024-09-11T08:18:08.743806+0000","last_became_active":"2024-09-11T08:18:04.409238+0000","last_became_peered":"2024-09-11T08:18:04.409238+0000","last_unstale":"2024-09-11T08:18:08.743806+0000","last_undegraded":"2024-09-11T08:18:08.743806+0000","last_fullsized":"2024-09-11T08:18:08.743806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:12:04.764695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473343+0000","last_change":"2024-09-11T08:18:00.384040+0000","last_active":"2024-09-11T08:18:09.473343+0000","last_peered":"2024-09-11T08:18:09.473343+0000","last_clean":"2024-09-11T08:18:09.473343+0000","last_became_active":"2024-09-11T08:18:00.383722+0000","last_became_peered":"2024-09-11T08:18:00.383722+0000","last_unstale":"2024-09-11T08:18:09.473343+0000","last_undegraded":"2024-09-11T08:18:09.473343+0000","last_fullsized":"2024-09-11T08:18:09.473343+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:40.957858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472273+0000","last_change":"2024-09-11T08:17:58.359168+0000","last_active":"2024-09-11T08:18:09.472273+0000","last_peered":"2024-09-11T08:18:09.472273+0000","last_clean":"2024-09-11T08:18:09.472273+0000","last_became_active":"2024-09-11T08:17:58.358913+0000","last_became_peered":"2024-09-11T08:17:58.358913+0000","last_unstale":"2024-09-11T08:18:09.472273+0000","last_undegraded":"2024-09-11T08:18:09.472273+0000","last_fullsized":"2024-09-11T08:18:09.472273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:44.693010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459676+0000","last_change":"2024-09-11T08:18:02.394595+0000","last_active":"2024-09-11T08:19:16.459676+0000","last_peered":"2024-09-11T08:19:16.459676+0000","last_clean":"2024-09-11T08:19:16.459676+0000","last_became_active":"2024-09-11T08:18:02.394302+0000","last_became_peered":"2024-09-11T08:18:02.394302+0000","last_unstale":"2024-09-11T08:19:16.459676+0000","last_undegraded":"2024-09-11T08:19:16.459676+0000","last_fullsized":"2024-09-11T08:19:16.459676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.821790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472025+0000","last_change":"2024-09-11T08:18:04.411596+0000","last_active":"2024-09-11T08:18:09.472025+0000","last_peered":"2024-09-11T08:18:09.472025+0000","last_clean":"2024-09-11T08:18:09.472025+0000","last_became_active":"2024-09-11T08:18:04.411340+0000","last_became_peered":"2024-09-11T08:18:04.411340+0000","last_unstale":"2024-09-11T08:18:09.472025+0000","last_undegraded":"2024-09-11T08:18:09.472025+0000","last_fullsized":"2024-09-11T08:18:09.472025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:11.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743962+0000","last_change":"2024-09-11T08:18:00.379486+0000","last_active":"2024-09-11T08:18:08.743962+0000","last_peered":"2024-09-11T08:18:08.743962+0000","last_clean":"2024-09-11T08:18:08.743962+0000","last_became_active":"2024-09-11T08:18:00.379131+0000","last_became_peered":"2024-09-11T08:18:00.379131+0000","last_unstale":"2024-09-11T08:18:08.743962+0000","last_undegraded":"2024-09-11T08:18:08.743962+0000","last_fullsized":"2024-09-11T08:18:08.743962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:57.484695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471472+0000","last_change":"2024-09-11T08:17:58.365539+0000","last_active":"2024-09-11T08:18:09.471472+0000","last_peered":"2024-09-11T08:18:09.471472+0000","last_clean":"2024-09-11T08:18:09.471472+0000","last_became_active":"2024-09-11T08:17:58.365159+0000","last_became_peered":"2024-09-11T08:17:58.365159+0000","last_unstale":"2024-09-11T08:18:09.471472+0000","last_undegraded":"2024-09-11T08:18:09.471472+0000","last_fullsized":"2024-09-11T08:18:09.471472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:05:28.474368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472478+0000","last_change":"2024-09-11T08:18:02.389846+0000","last_active":"2024-09-11T08:18:09.472478+0000","last_peered":"2024-09-11T08:18:09.472478+0000","last_clean":"2024-09-11T08:18:09.472478+0000","last_became_active":"2024-09-11T08:18:02.389549+0000","last_became_peered":"2024-09-11T08:18:02.389549+0000","last_unstale":"2024-09-11T08:18:09.472478+0000","last_undegraded":"2024-09-11T08:18:09.472478+0000","last_fullsized":"2024-09-11T08:18:09.472478+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:47:28.732881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076784+0000","last_change":"2024-09-11T08:18:04.442977+0000","last_active":"2024-09-11T08:18:09.076784+0000","last_peered":"2024-09-11T08:18:09.076784+0000","last_clean":"2024-09-11T08:18:09.076784+0000","last_became_active":"2024-09-11T08:18:04.442711+0000","last_became_peered":"2024-09-11T08:18:04.442711+0000","last_unstale":"2024-09-11T08:18:09.076784+0000","last_undegraded":"2024-09-11T08:18:09.076784+0000","last_fullsized":"2024-09-11T08:18:09.076784+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:46:28.531736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"60'14","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743401+0000","last_change":"2024-09-11T08:18:00.375661+0000","last_active":"2024-09-11T08:18:08.743401+0000","last_peered":"2024-09-11T08:18:08.743401+0000","last_clean":"2024-09-11T08:18:08.743401+0000","last_became_active":"2024-09-11T08:18:00.375366+0000","last_became_peered":"2024-09-11T08:18:00.375366+0000","last_unstale":"2024-09-11T08:18:08.743401+0000","last_undegraded":"2024-09-11T08:18:08.743401+0000","last_fullsized":"2024-09-11T08:18:08.743401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:04.636406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382429+0000","last_change":"2024-09-11T08:17:58.363243+0000","last_active":"2024-09-11T08:18:09.382429+0000","last_peered":"2024-09-11T08:18:09.382429+0000","last_clean":"2024-09-11T08:18:09.382429+0000","last_became_active":"2024-09-11T08:17:58.362997+0000","last_became_peered":"2024-09-11T08:17:58.362997+0000","last_unstale":"2024-09-11T08:18:09.382429+0000","last_undegraded":"2024-09-11T08:18:09.382429+0000","last_fullsized":"2024-09-11T08:18:09.382429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:16.696635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459482+0000","last_change":"2024-09-11T08:18:02.394911+0000","last_active":"2024-09-11T08:19:16.459482+0000","last_peered":"2024-09-11T08:19:16.459482+0000","last_clean":"2024-09-11T08:19:16.459482+0000","last_became_active":"2024-09-11T08:18:02.394287+0000","last_became_peered":"2024-09-11T08:18:02.394287+0000","last_unstale":"2024-09-11T08:19:16.459482+0000","last_undegraded":"2024-09-11T08:19:16.459482+0000","last_fullsized":"2024-09-11T08:19:16.459482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:42.491937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471871+0000","last_change":"2024-09-11T08:18:04.444179+0000","last_active":"2024-09-11T08:18:09.471871+0000","last_peered":"2024-09-11T08:18:09.471871+0000","last_clean":"2024-09-11T08:18:09.471871+0000","last_became_active":"2024-09-11T08:18:04.443823+0000","last_became_peered":"2024-09-11T08:18:04.443823+0000","last_unstale":"2024-09-11T08:18:09.471871+0000","last_undegraded":"2024-09-11T08:18:09.471871+0000","last_fullsized":"2024-09-11T08:18:09.471871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:13.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"60'18","reported_seq":48,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076904+0000","last_change":"2024-09-11T08:18:00.520114+0000","last_active":"2024-09-11T08:18:09.076904+0000","last_peered":"2024-09-11T08:18:09.076904+0000","last_clean":"2024-09-11T08:18:09.076904+0000","last_became_active":"2024-09-11T08:18:00.519777+0000","last_became_peered":"2024-09-11T08:18:00.519777+0000","last_unstale":"2024-09-11T08:18:09.076904+0000","last_undegraded":"2024-09-11T08:18:09.076904+0000","last_fullsized":"2024-09-11T08:18:09.076904+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:18.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473096+0000","last_change":"2024-09-11T08:17:58.357477+0000","last_active":"2024-09-11T08:18:09.473096+0000","last_peered":"2024-09-11T08:18:09.473096+0000","last_clean":"2024-09-11T08:18:09.473096+0000","last_became_active":"2024-09-11T08:17:58.357202+0000","last_became_peered":"2024-09-11T08:17:58.357202+0000","last_unstale":"2024-09-11T08:18:09.473096+0000","last_undegraded":"2024-09-11T08:18:09.473096+0000","last_fullsized":"2024-09-11T08:18:09.473096+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:24:28.595825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743313+0000","last_change":"2024-09-11T08:18:02.394277+0000","last_active":"2024-09-11T08:18:08.743313+0000","last_peered":"2024-09-11T08:18:08.743313+0000","last_clean":"2024-09-11T08:18:08.743313+0000","last_became_active":"2024-09-11T08:18:02.393997+0000","last_became_peered":"2024-09-11T08:18:02.393997+0000","last_unstale":"2024-09-11T08:18:08.743313+0000","last_undegraded":"2024-09-11T08:18:08.743313+0000","last_fullsized":"2024-09-11T08:18:08.743313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:23.834879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743505+0000","last_change":"2024-09-11T08:18:04.413060+0000","last_active":"2024-09-11T08:18:08.743505+0000","last_peered":"2024-09-11T08:18:08.743505+0000","last_clean":"2024-09-11T08:18:08.743505+0000","last_became_active":"2024-09-11T08:18:04.412885+0000","last_became_peered":"2024-09-11T08:18:04.412885+0000","last_unstale":"2024-09-11T08:18:08.743505+0000","last_undegraded":"2024-09-11T08:18:08.743505+0000","last_fullsized":"2024-09-11T08:18:08.743505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:53.486303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"60'19","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747973+0000","last_change":"2024-09-11T08:18:00.520224+0000","last_active":"2024-09-11T08:18:08.747973+0000","last_peered":"2024-09-11T08:18:08.747973+0000","last_clean":"2024-09-11T08:18:08.747973+0000","last_became_active":"2024-09-11T08:18:00.519943+0000","last_became_peered":"2024-09-11T08:18:00.519943+0000","last_unstale":"2024-09-11T08:18:08.747973+0000","last_undegraded":"2024-09-11T08:18:08.747973+0000","last_fullsized":"2024-09-11T08:18:08.747973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:44:06.515803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472833+0000","last_change":"2024-09-11T08:17:58.365941+0000","last_active":"2024-09-11T08:18:09.472833+0000","last_peered":"2024-09-11T08:18:09.472833+0000","last_clean":"2024-09-11T08:18:09.472833+0000","last_became_active":"2024-09-11T08:17:58.365396+0000","last_became_peered":"2024-09-11T08:17:58.365396+0000","last_unstale":"2024-09-11T08:18:09.472833+0000","last_undegraded":"2024-09-11T08:18:09.472833+0000","last_fullsized":"2024-09-11T08:18:09.472833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:57.033535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382100+0000","last_change":"2024-09-11T08:18:02.398208+0000","last_active":"2024-09-11T08:18:09.382100+0000","last_peered":"2024-09-11T08:18:09.382100+0000","last_clean":"2024-09-11T08:18:09.382100+0000","last_became_active":"2024-09-11T08:18:02.397878+0000","last_became_peered":"2024-09-11T08:18:02.397878+0000","last_unstale":"2024-09-11T08:18:09.382100+0000","last_undegraded":"2024-09-11T08:18:09.382100+0000","last_fullsized":"2024-09-11T08:18:09.382100+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:20.781427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471965+0000","last_change":"2024-09-11T08:18:04.443766+0000","last_active":"2024-09-11T08:18:09.471965+0000","last_peered":"2024-09-11T08:18:09.471965+0000","last_clean":"2024-09-11T08:18:09.471965+0000","last_became_active":"2024-09-11T08:18:04.443184+0000","last_became_peered":"2024-09-11T08:18:04.443184+0000","last_unstale":"2024-09-11T08:18:09.471965+0000","last_undegraded":"2024-09-11T08:18:09.471965+0000","last_fullsized":"2024-09-11T08:18:09.471965+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:28:34.839105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472811+0000","last_change":"2024-09-11T08:18:00.378363+0000","last_active":"2024-09-11T08:18:09.472811+0000","last_peered":"2024-09-11T08:18:09.472811+0000","last_clean":"2024-09-11T08:18:09.472811+0000","last_became_active":"2024-09-11T08:18:00.377980+0000","last_became_peered":"2024-09-11T08:18:00.377980+0000","last_unstale":"2024-09-11T08:18:09.472811+0000","last_undegraded":"2024-09-11T08:18:09.472811+0000","last_fullsized":"2024-09-11T08:18:09.472811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:31.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472786+0000","last_change":"2024-09-11T08:17:58.358513+0000","last_active":"2024-09-11T08:18:09.472786+0000","last_peered":"2024-09-11T08:18:09.472786+0000","last_clean":"2024-09-11T08:18:09.472786+0000","last_became_active":"2024-09-11T08:17:58.358245+0000","last_became_peered":"2024-09-11T08:17:58.358245+0000","last_unstale":"2024-09-11T08:18:09.472786+0000","last_undegraded":"2024-09-11T08:18:09.472786+0000","last_fullsized":"2024-09-11T08:18:09.472786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.405434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459494+0000","last_change":"2024-09-11T08:18:02.390518+0000","last_active":"2024-09-11T08:19:16.459494+0000","last_peered":"2024-09-11T08:19:16.459494+0000","last_clean":"2024-09-11T08:19:16.459494+0000","last_became_active":"2024-09-11T08:18:02.390250+0000","last_became_peered":"2024-09-11T08:18:02.390250+0000","last_unstale":"2024-09-11T08:19:16.459494+0000","last_undegraded":"2024-09-11T08:19:16.459494+0000","last_fullsized":"2024-09-11T08:19:16.459494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:40.353983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747309+0000","last_change":"2024-09-11T08:18:04.417161+0000","last_active":"2024-09-11T08:18:08.747309+0000","last_peered":"2024-09-11T08:18:08.747309+0000","last_clean":"2024-09-11T08:18:08.747309+0000","last_became_active":"2024-09-11T08:18:04.415877+0000","last_became_peered":"2024-09-11T08:18:04.415877+0000","last_unstale":"2024-09-11T08:18:08.747309+0000","last_undegraded":"2024-09-11T08:18:08.747309+0000","last_fullsized":"2024-09-11T08:18:08.747309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:26:21.377950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'28","reported_seq":81,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459466+0000","last_change":"2024-09-11T08:18:00.383911+0000","last_active":"2024-09-11T08:19:16.459466+0000","last_peered":"2024-09-11T08:19:16.459466+0000","last_clean":"2024-09-11T08:19:16.459466+0000","last_became_active":"2024-09-11T08:18:00.383674+0000","last_became_peered":"2024-09-11T08:18:00.383674+0000","last_unstale":"2024-09-11T08:19:16.459466+0000","last_undegraded":"2024-09-11T08:19:16.459466+0000","last_fullsized":"2024-09-11T08:19:16.459466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:51.237870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472591+0000","last_change":"2024-09-11T08:17:58.356629+0000","last_active":"2024-09-11T08:18:09.472591+0000","last_peered":"2024-09-11T08:18:09.472591+0000","last_clean":"2024-09-11T08:18:09.472591+0000","last_became_active":"2024-09-11T08:17:58.356345+0000","last_became_peered":"2024-09-11T08:17:58.356345+0000","last_unstale":"2024-09-11T08:18:09.472591+0000","last_undegraded":"2024-09-11T08:18:09.472591+0000","last_fullsized":"2024-09-11T08:18:09.472591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:59.617519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748125+0000","last_change":"2024-09-11T08:18:02.389590+0000","last_active":"2024-09-11T08:18:08.748125+0000","last_peered":"2024-09-11T08:18:08.748125+0000","last_clean":"2024-09-11T08:18:08.748125+0000","last_became_active":"2024-09-11T08:18:02.389296+0000","last_became_peered":"2024-09-11T08:18:02.389296+0000","last_unstale":"2024-09-11T08:18:08.748125+0000","last_undegraded":"2024-09-11T08:18:08.748125+0000","last_fullsized":"2024-09-11T08:18:08.748125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:48.847680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077017+0000","last_change":"2024-09-11T08:18:04.414431+0000","last_active":"2024-09-11T08:18:09.077017+0000","last_peered":"2024-09-11T08:18:09.077017+0000","last_clean":"2024-09-11T08:18:09.077017+0000","last_became_active":"2024-09-11T08:18:04.414136+0000","last_became_peered":"2024-09-11T08:18:04.414136+0000","last_unstale":"2024-09-11T08:18:09.077017+0000","last_undegraded":"2024-09-11T08:18:09.077017+0000","last_fullsized":"2024-09-11T08:18:09.077017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:26.899542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'13","reported_seq":43,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473376+0000","last_change":"2024-09-11T08:18:00.378438+0000","last_active":"2024-09-11T08:18:09.473376+0000","last_peered":"2024-09-11T08:18:09.473376+0000","last_clean":"2024-09-11T08:18:09.473376+0000","last_became_active":"2024-09-11T08:18:00.378200+0000","last_became_peered":"2024-09-11T08:18:00.378200+0000","last_unstale":"2024-09-11T08:18:09.473376+0000","last_undegraded":"2024-09-11T08:18:09.473376+0000","last_fullsized":"2024-09-11T08:18:09.473376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:21:12.222068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'5","reported_seq":106,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:24.009846+0000","last_change":"2024-09-11T08:18:02.384812+0000","last_active":"2024-09-11T08:19:24.009846+0000","last_peered":"2024-09-11T08:19:24.009846+0000","last_clean":"2024-09-11T08:19:24.009846+0000","last_became_active":"2024-09-11T08:17:58.362664+0000","last_became_peered":"2024-09-11T08:17:58.362664+0000","last_unstale":"2024-09-11T08:19:24.009846+0000","last_undegraded":"2024-09-11T08:19:24.009846+0000","last_fullsized":"2024-09-11T08:19:24.009846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:45.805335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012178709999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471922+0000","last_change":"2024-09-11T08:17:58.360630+0000","last_active":"2024-09-11T08:18:09.471922+0000","last_peered":"2024-09-11T08:18:09.471922+0000","last_clean":"2024-09-11T08:18:09.471922+0000","last_became_active":"2024-09-11T08:17:58.360371+0000","last_became_peered":"2024-09-11T08:17:58.360371+0000","last_unstale":"2024-09-11T08:18:09.471922+0000","last_undegraded":"2024-09-11T08:18:09.471922+0000","last_fullsized":"2024-09-11T08:18:09.471922+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:34.286130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471872+0000","last_change":"2024-09-11T08:18:02.387913+0000","last_active":"2024-09-11T08:18:09.471872+0000","last_peered":"2024-09-11T08:18:09.471872+0000","last_clean":"2024-09-11T08:18:09.471872+0000","last_became_active":"2024-09-11T08:18:02.387594+0000","last_became_peered":"2024-09-11T08:18:02.387594+0000","last_unstale":"2024-09-11T08:18:09.471872+0000","last_undegraded":"2024-09-11T08:18:09.471872+0000","last_fullsized":"2024-09-11T08:18:09.471872+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:19:47.908684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472384+0000","last_change":"2024-09-11T08:18:04.444365+0000","last_active":"2024-09-11T08:18:09.472384+0000","last_peered":"2024-09-11T08:18:09.472384+0000","last_clean":"2024-09-11T08:18:09.472384+0000","last_became_active":"2024-09-11T08:18:04.443811+0000","last_became_peered":"2024-09-11T08:18:04.443811+0000","last_unstale":"2024-09-11T08:18:09.472384+0000","last_undegraded":"2024-09-11T08:18:09.472384+0000","last_fullsized":"2024-09-11T08:18:09.472384+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:02:50.285316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748420+0000","last_change":"2024-09-11T08:18:00.379468+0000","last_active":"2024-09-11T08:18:08.748420+0000","last_peered":"2024-09-11T08:18:08.748420+0000","last_clean":"2024-09-11T08:18:08.748420+0000","last_became_active":"2024-09-11T08:18:00.379159+0000","last_became_peered":"2024-09-11T08:18:00.379159+0000","last_unstale":"2024-09-11T08:18:08.748420+0000","last_undegraded":"2024-09-11T08:18:08.748420+0000","last_fullsized":"2024-09-11T08:18:08.748420+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:03.800446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"55'1","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747682+0000","last_change":"2024-09-11T08:18:02.383441+0000","last_active":"2024-09-11T08:18:08.747682+0000","last_peered":"2024-09-11T08:18:08.747682+0000","last_clean":"2024-09-11T08:18:08.747682+0000","last_became_active":"2024-09-11T08:17:58.363254+0000","last_became_peered":"2024-09-11T08:17:58.363254+0000","last_unstale":"2024-09-11T08:18:08.747682+0000","last_undegraded":"2024-09-11T08:18:08.747682+0000","last_fullsized":"2024-09-11T08:18:08.747682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:29:01.355163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044148400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471539+0000","last_change":"2024-09-11T08:17:58.366159+0000","last_active":"2024-09-11T08:18:09.471539+0000","last_peered":"2024-09-11T08:18:09.471539+0000","last_clean":"2024-09-11T08:18:09.471539+0000","last_became_active":"2024-09-11T08:17:58.365901+0000","last_became_peered":"2024-09-11T08:17:58.365901+0000","last_unstale":"2024-09-11T08:18:09.471539+0000","last_undegraded":"2024-09-11T08:18:09.471539+0000","last_fullsized":"2024-09-11T08:18:09.471539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:23.534962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472459+0000","last_change":"2024-09-11T08:18:02.394713+0000","last_active":"2024-09-11T08:18:09.472459+0000","last_peered":"2024-09-11T08:18:09.472459+0000","last_clean":"2024-09-11T08:18:09.472459+0000","last_became_active":"2024-09-11T08:18:02.394433+0000","last_became_peered":"2024-09-11T08:18:02.394433+0000","last_unstale":"2024-09-11T08:18:09.472459+0000","last_undegraded":"2024-09-11T08:18:09.472459+0000","last_fullsized":"2024-09-11T08:18:09.472459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:43.535958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472159+0000","last_change":"2024-09-11T08:18:04.415996+0000","last_active":"2024-09-11T08:18:09.472159+0000","last_peered":"2024-09-11T08:18:09.472159+0000","last_clean":"2024-09-11T08:18:09.472159+0000","last_became_active":"2024-09-11T08:18:04.415657+0000","last_became_peered":"2024-09-11T08:18:04.415657+0000","last_unstale":"2024-09-11T08:18:09.472159+0000","last_undegraded":"2024-09-11T08:18:09.472159+0000","last_fullsized":"2024-09-11T08:18:09.472159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:44:35.343736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'14","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382264+0000","last_change":"2024-09-11T08:18:00.520170+0000","last_active":"2024-09-11T08:18:09.382264+0000","last_peered":"2024-09-11T08:18:09.382264+0000","last_clean":"2024-09-11T08:18:09.382264+0000","last_became_active":"2024-09-11T08:18:00.519866+0000","last_became_peered":"2024-09-11T08:18:00.519866+0000","last_unstale":"2024-09-11T08:18:09.382264+0000","last_undegraded":"2024-09-11T08:18:09.382264+0000","last_fullsized":"2024-09-11T08:18:09.382264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:16:13.115745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"57'2","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076896+0000","last_change":"2024-09-11T08:18:02.388434+0000","last_active":"2024-09-11T08:18:09.076896+0000","last_peered":"2024-09-11T08:18:09.076896+0000","last_clean":"2024-09-11T08:18:09.076896+0000","last_became_active":"2024-09-11T08:17:58.364149+0000","last_became_peered":"2024-09-11T08:17:58.364149+0000","last_unstale":"2024-09-11T08:18:09.076896+0000","last_undegraded":"2024-09-11T08:18:09.076896+0000","last_fullsized":"2024-09-11T08:18:09.076896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:24.771375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030615939999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471751+0000","last_change":"2024-09-11T08:17:58.359370+0000","last_active":"2024-09-11T08:18:09.471751+0000","last_peered":"2024-09-11T08:18:09.471751+0000","last_clean":"2024-09-11T08:18:09.471751+0000","last_became_active":"2024-09-11T08:17:58.359081+0000","last_became_peered":"2024-09-11T08:17:58.359081+0000","last_unstale":"2024-09-11T08:18:09.471751+0000","last_undegraded":"2024-09-11T08:18:09.471751+0000","last_fullsized":"2024-09-11T08:18:09.471751+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:08.045976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"62'79","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:18:36.747224+0000","last_change":"2024-09-11T08:17:47.535403+0000","last_active":"2024-09-11T08:18:36.747224+0000","last_peered":"2024-09-11T08:18:36.747224+0000","last_clean":"2024-09-11T08:18:36.747224+0000","last_became_active":"2024-09-11T08:17:47.531270+0000","last_became_peered":"2024-09-11T08:17:47.531270+0000","last_unstale":"2024-09-11T08:18:36.747224+0000","last_undegraded":"2024-09-11T08:18:36.747224+0000","last_fullsized":"2024-09-11T08:18:36.747224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:15:48.959858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:15:48.959858+0000","last_clean_scrub_stamp":"2024-09-11T08:15:48.959858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:17.028056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472247+0000","last_change":"2024-09-11T08:18:02.389964+0000","last_active":"2024-09-11T08:18:09.472247+0000","last_peered":"2024-09-11T08:18:09.472247+0000","last_clean":"2024-09-11T08:18:09.472247+0000","last_became_active":"2024-09-11T08:18:02.389317+0000","last_became_peered":"2024-09-11T08:18:02.389317+0000","last_unstale":"2024-09-11T08:18:09.472247+0000","last_undegraded":"2024-09-11T08:18:09.472247+0000","last_fullsized":"2024-09-11T08:18:09.472247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472578+0000","last_change":"2024-09-11T08:18:04.415822+0000","last_active":"2024-09-11T08:18:09.472578+0000","last_peered":"2024-09-11T08:18:09.472578+0000","last_clean":"2024-09-11T08:18:09.472578+0000","last_became_active":"2024-09-11T08:18:04.415516+0000","last_became_peered":"2024-09-11T08:18:04.415516+0000","last_unstale":"2024-09-11T08:18:09.472578+0000","last_undegraded":"2024-09-11T08:18:09.472578+0000","last_fullsized":"2024-09-11T08:18:09.472578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:45:43.135489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"60'19","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382162+0000","last_change":"2024-09-11T08:18:00.520179+0000","last_active":"2024-09-11T08:18:09.382162+0000","last_peered":"2024-09-11T08:18:09.382162+0000","last_clean":"2024-09-11T08:18:09.382162+0000","last_became_active":"2024-09-11T08:18:00.519893+0000","last_became_peered":"2024-09-11T08:18:00.519893+0000","last_unstale":"2024-09-11T08:18:09.382162+0000","last_undegraded":"2024-09-11T08:18:09.382162+0000","last_fullsized":"2024-09-11T08:18:09.382162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:45.145939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472682+0000","last_change":"2024-09-11T08:17:58.356997+0000","last_active":"2024-09-11T08:18:09.472682+0000","last_peered":"2024-09-11T08:18:09.472682+0000","last_clean":"2024-09-11T08:18:09.472682+0000","last_became_active":"2024-09-11T08:17:58.356738+0000","last_became_peered":"2024-09-11T08:17:58.356738+0000","last_unstale":"2024-09-11T08:18:09.472682+0000","last_undegraded":"2024-09-11T08:18:09.472682+0000","last_fullsized":"2024-09-11T08:18:09.472682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:32.279057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472388+0000","last_change":"2024-09-11T08:18:02.389777+0000","last_active":"2024-09-11T08:18:09.472388+0000","last_peered":"2024-09-11T08:18:09.472388+0000","last_clean":"2024-09-11T08:18:09.472388+0000","last_became_active":"2024-09-11T08:18:02.389477+0000","last_became_peered":"2024-09-11T08:18:02.389477+0000","last_unstale":"2024-09-11T08:18:09.472388+0000","last_undegraded":"2024-09-11T08:18:09.472388+0000","last_fullsized":"2024-09-11T08:18:09.472388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:28.929835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471590+0000","last_change":"2024-09-11T08:18:04.415248+0000","last_active":"2024-09-11T08:18:09.471590+0000","last_peered":"2024-09-11T08:18:09.471590+0000","last_clean":"2024-09-11T08:18:09.471590+0000","last_became_active":"2024-09-11T08:18:04.414978+0000","last_became_peered":"2024-09-11T08:18:04.414978+0000","last_unstale":"2024-09-11T08:18:09.471590+0000","last_undegraded":"2024-09-11T08:18:09.471590+0000","last_fullsized":"2024-09-11T08:18:09.471590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:51.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747886+0000","last_change":"2024-09-11T08:18:00.377316+0000","last_active":"2024-09-11T08:18:08.747886+0000","last_peered":"2024-09-11T08:18:08.747886+0000","last_clean":"2024-09-11T08:18:08.747886+0000","last_became_active":"2024-09-11T08:18:00.376878+0000","last_became_peered":"2024-09-11T08:18:00.376878+0000","last_unstale":"2024-09-11T08:18:08.747886+0000","last_undegraded":"2024-09-11T08:18:08.747886+0000","last_fullsized":"2024-09-11T08:18:08.747886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:56.565389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473285+0000","last_change":"2024-09-11T08:17:58.362161+0000","last_active":"2024-09-11T08:18:09.473285+0000","last_peered":"2024-09-11T08:18:09.473285+0000","last_clean":"2024-09-11T08:18:09.473285+0000","last_became_active":"2024-09-11T08:17:58.361891+0000","last_became_peered":"2024-09-11T08:17:58.361891+0000","last_unstale":"2024-09-11T08:18:09.473285+0000","last_undegraded":"2024-09-11T08:18:09.473285+0000","last_fullsized":"2024-09-11T08:18:09.473285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:18.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471739+0000","last_change":"2024-09-11T08:18:02.394641+0000","last_active":"2024-09-11T08:18:09.471739+0000","last_peered":"2024-09-11T08:18:09.471739+0000","last_clean":"2024-09-11T08:18:09.471739+0000","last_became_active":"2024-09-11T08:18:02.394345+0000","last_became_peered":"2024-09-11T08:18:02.394345+0000","last_unstale":"2024-09-11T08:18:09.471739+0000","last_undegraded":"2024-09-11T08:18:09.471739+0000","last_fullsized":"2024-09-11T08:18:09.471739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:51.377855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747564+0000","last_change":"2024-09-11T08:18:04.413429+0000","last_active":"2024-09-11T08:18:08.747564+0000","last_peered":"2024-09-11T08:18:08.747564+0000","last_clean":"2024-09-11T08:18:08.747564+0000","last_became_active":"2024-09-11T08:18:04.413115+0000","last_became_peered":"2024-09-11T08:18:04.413115+0000","last_unstale":"2024-09-11T08:18:08.747564+0000","last_undegraded":"2024-09-11T08:18:08.747564+0000","last_fullsized":"2024-09-11T08:18:08.747564+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:44.902232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471209+0000","last_change":"2024-09-11T08:18:00.520459+0000","last_active":"2024-09-11T08:18:09.471209+0000","last_peered":"2024-09-11T08:18:09.471209+0000","last_clean":"2024-09-11T08:18:09.471209+0000","last_became_active":"2024-09-11T08:18:00.520032+0000","last_became_peered":"2024-09-11T08:18:00.520032+0000","last_unstale":"2024-09-11T08:18:09.471209+0000","last_undegraded":"2024-09-11T08:18:09.471209+0000","last_fullsized":"2024-09-11T08:18:09.471209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:11.421002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472160+0000","last_change":"2024-09-11T08:17:58.366165+0000","last_active":"2024-09-11T08:18:09.472160+0000","last_peered":"2024-09-11T08:18:09.472160+0000","last_clean":"2024-09-11T08:18:09.472160+0000","last_became_active":"2024-09-11T08:17:58.365850+0000","last_became_peered":"2024-09-11T08:17:58.365850+0000","last_unstale":"2024-09-11T08:18:09.472160+0000","last_undegraded":"2024-09-11T08:18:09.472160+0000","last_fullsized":"2024-09-11T08:18:09.472160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:50:55.659159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459676+0000","last_change":"2024-09-11T08:18:02.390319+0000","last_active":"2024-09-11T08:19:16.459676+0000","last_peered":"2024-09-11T08:19:16.459676+0000","last_clean":"2024-09-11T08:19:16.459676+0000","last_became_active":"2024-09-11T08:18:02.389556+0000","last_became_peered":"2024-09-11T08:18:02.389556+0000","last_unstale":"2024-09-11T08:19:16.459676+0000","last_undegraded":"2024-09-11T08:19:16.459676+0000","last_fullsized":"2024-09-11T08:19:16.459676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:29:48.969198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471376+0000","last_change":"2024-09-11T08:18:04.444996+0000","last_active":"2024-09-11T08:18:09.471376+0000","last_peered":"2024-09-11T08:18:09.471376+0000","last_clean":"2024-09-11T08:18:09.471376+0000","last_became_active":"2024-09-11T08:18:04.444709+0000","last_became_peered":"2024-09-11T08:18:04.444709+0000","last_unstale":"2024-09-11T08:18:09.471376+0000","last_undegraded":"2024-09-11T08:18:09.471376+0000","last_fullsized":"2024-09-11T08:18:09.471376+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:39.444151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"60'12","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743323+0000","last_change":"2024-09-11T08:18:00.384021+0000","last_active":"2024-09-11T08:18:08.743323+0000","last_peered":"2024-09-11T08:18:08.743323+0000","last_clean":"2024-09-11T08:18:08.743323+0000","last_became_active":"2024-09-11T08:18:00.383792+0000","last_became_peered":"2024-09-11T08:18:00.383792+0000","last_unstale":"2024-09-11T08:18:08.743323+0000","last_undegraded":"2024-09-11T08:18:08.743323+0000","last_fullsized":"2024-09-11T08:18:08.743323+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:14:57.106894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"53'2","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.744073+0000","last_change":"2024-09-11T08:17:58.357964+0000","last_active":"2024-09-11T08:18:08.744073+0000","last_peered":"2024-09-11T08:18:08.744073+0000","last_clean":"2024-09-11T08:18:08.744073+0000","last_became_active":"2024-09-11T08:17:58.357693+0000","last_became_peered":"2024-09-11T08:17:58.357693+0000","last_unstale":"2024-09-11T08:18:08.744073+0000","last_undegraded":"2024-09-11T08:18:08.744073+0000","last_fullsized":"2024-09-11T08:18:08.744073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:32.360350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471695+0000","last_change":"2024-09-11T08:18:02.386200+0000","last_active":"2024-09-11T08:18:09.471695+0000","last_peered":"2024-09-11T08:18:09.471695+0000","last_clean":"2024-09-11T08:18:09.471695+0000","last_became_active":"2024-09-11T08:18:02.385798+0000","last_became_peered":"2024-09-11T08:18:02.385798+0000","last_unstale":"2024-09-11T08:18:09.471695+0000","last_undegraded":"2024-09-11T08:18:09.471695+0000","last_fullsized":"2024-09-11T08:18:09.471695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:59:40.578736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076639+0000","last_change":"2024-09-11T08:18:04.413455+0000","last_active":"2024-09-11T08:18:09.076639+0000","last_peered":"2024-09-11T08:18:09.076639+0000","last_clean":"2024-09-11T08:18:09.076639+0000","last_became_active":"2024-09-11T08:18:04.413188+0000","last_became_peered":"2024-09-11T08:18:04.413188+0000","last_unstale":"2024-09-11T08:18:09.076639+0000","last_undegraded":"2024-09-11T08:18:09.076639+0000","last_fullsized":"2024-09-11T08:18:09.076639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:24.468317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748345+0000","last_change":"2024-09-11T08:18:00.520384+0000","last_active":"2024-09-11T08:18:08.748345+0000","last_peered":"2024-09-11T08:18:08.748345+0000","last_clean":"2024-09-11T08:18:08.748345+0000","last_became_active":"2024-09-11T08:18:00.520126+0000","last_became_peered":"2024-09-11T08:18:00.520126+0000","last_unstale":"2024-09-11T08:18:08.748345+0000","last_undegraded":"2024-09-11T08:18:08.748345+0000","last_fullsized":"2024-09-11T08:18:08.748345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:46.312895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472476+0000","last_change":"2024-09-11T08:17:58.358077+0000","last_active":"2024-09-11T08:18:09.472476+0000","last_peered":"2024-09-11T08:18:09.472476+0000","last_clean":"2024-09-11T08:18:09.472476+0000","last_became_active":"2024-09-11T08:17:58.357813+0000","last_became_peered":"2024-09-11T08:17:58.357813+0000","last_unstale":"2024-09-11T08:18:09.472476+0000","last_undegraded":"2024-09-11T08:18:09.472476+0000","last_fullsized":"2024-09-11T08:18:09.472476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:07.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077203+0000","last_change":"2024-09-11T08:18:02.393530+0000","last_active":"2024-09-11T08:18:09.077203+0000","last_peered":"2024-09-11T08:18:09.077203+0000","last_clean":"2024-09-11T08:18:09.077203+0000","last_became_active":"2024-09-11T08:18:02.393208+0000","last_became_peered":"2024-09-11T08:18:02.393208+0000","last_unstale":"2024-09-11T08:18:09.077203+0000","last_undegraded":"2024-09-11T08:18:09.077203+0000","last_fullsized":"2024-09-11T08:18:09.077203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:29.190564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472197+0000","last_change":"2024-09-11T08:18:04.407441+0000","last_active":"2024-09-11T08:18:09.472197+0000","last_peered":"2024-09-11T08:18:09.472197+0000","last_clean":"2024-09-11T08:18:09.472197+0000","last_became_active":"2024-09-11T08:18:04.407168+0000","last_became_peered":"2024-09-11T08:18:04.407168+0000","last_unstale":"2024-09-11T08:18:09.472197+0000","last_undegraded":"2024-09-11T08:18:09.472197+0000","last_fullsized":"2024-09-11T08:18:09.472197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:11.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382027+0000","last_change":"2024-09-11T08:17:58.361771+0000","last_active":"2024-09-11T08:18:09.382027+0000","last_peered":"2024-09-11T08:18:09.382027+0000","last_clean":"2024-09-11T08:18:09.382027+0000","last_became_active":"2024-09-11T08:17:58.359272+0000","last_became_peered":"2024-09-11T08:17:58.359272+0000","last_unstale":"2024-09-11T08:18:09.382027+0000","last_undegraded":"2024-09-11T08:18:09.382027+0000","last_fullsized":"2024-09-11T08:18:09.382027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:44:55.513104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'6","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077295+0000","last_change":"2024-09-11T08:18:00.520055+0000","last_active":"2024-09-11T08:18:09.077295+0000","last_peered":"2024-09-11T08:18:09.077295+0000","last_clean":"2024-09-11T08:18:09.077295+0000","last_became_active":"2024-09-11T08:18:00.519688+0000","last_became_peered":"2024-09-11T08:18:00.519688+0000","last_unstale":"2024-09-11T08:18:09.077295+0000","last_undegraded":"2024-09-11T08:18:09.077295+0000","last_fullsized":"2024-09-11T08:18:09.077295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:35.352061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472188+0000","last_change":"2024-09-11T08:18:02.393997+0000","last_active":"2024-09-11T08:18:09.472188+0000","last_peered":"2024-09-11T08:18:09.472188+0000","last_clean":"2024-09-11T08:18:09.472188+0000","last_became_active":"2024-09-11T08:18:02.393716+0000","last_became_peered":"2024-09-11T08:18:02.393716+0000","last_unstale":"2024-09-11T08:18:09.472188+0000","last_undegraded":"2024-09-11T08:18:09.472188+0000","last_fullsized":"2024-09-11T08:18:09.472188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:34.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472306+0000","last_change":"2024-09-11T08:18:04.444236+0000","last_active":"2024-09-11T08:18:09.472306+0000","last_peered":"2024-09-11T08:18:09.472306+0000","last_clean":"2024-09-11T08:18:09.472306+0000","last_became_active":"2024-09-11T08:18:04.443908+0000","last_became_peered":"2024-09-11T08:18:04.443908+0000","last_unstale":"2024-09-11T08:18:09.472306+0000","last_undegraded":"2024-09-11T08:18:09.472306+0000","last_fullsized":"2024-09-11T08:18:09.472306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:58.588867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077320+0000","last_change":"2024-09-11T08:18:00.520252+0000","last_active":"2024-09-11T08:18:09.077320+0000","last_peered":"2024-09-11T08:18:09.077320+0000","last_clean":"2024-09-11T08:18:09.077320+0000","last_became_active":"2024-09-11T08:18:00.519974+0000","last_became_peered":"2024-09-11T08:18:00.519974+0000","last_unstale":"2024-09-11T08:18:09.077320+0000","last_undegraded":"2024-09-11T08:18:09.077320+0000","last_fullsized":"2024-09-11T08:18:09.077320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:27.962920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472667+0000","last_change":"2024-09-11T08:17:58.361893+0000","last_active":"2024-09-11T08:18:09.472667+0000","last_peered":"2024-09-11T08:18:09.472667+0000","last_clean":"2024-09-11T08:18:09.472667+0000","last_became_active":"2024-09-11T08:17:58.361639+0000","last_became_peered":"2024-09-11T08:17:58.361639+0000","last_unstale":"2024-09-11T08:18:09.472667+0000","last_undegraded":"2024-09-11T08:18:09.472667+0000","last_fullsized":"2024-09-11T08:18:09.472667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:26.091382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459728+0000","last_change":"2024-09-11T08:18:02.395869+0000","last_active":"2024-09-11T08:19:16.459728+0000","last_peered":"2024-09-11T08:19:16.459728+0000","last_clean":"2024-09-11T08:19:16.459728+0000","last_became_active":"2024-09-11T08:18:02.394374+0000","last_became_peered":"2024-09-11T08:18:02.394374+0000","last_unstale":"2024-09-11T08:19:16.459728+0000","last_undegraded":"2024-09-11T08:19:16.459728+0000","last_fullsized":"2024-09-11T08:19:16.459728+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:42.701032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748215+0000","last_change":"2024-09-11T08:18:04.415663+0000","last_active":"2024-09-11T08:18:08.748215+0000","last_peered":"2024-09-11T08:18:08.748215+0000","last_clean":"2024-09-11T08:18:08.748215+0000","last_became_active":"2024-09-11T08:18:04.415380+0000","last_became_peered":"2024-09-11T08:18:04.415380+0000","last_unstale":"2024-09-11T08:18:08.748215+0000","last_undegraded":"2024-09-11T08:18:08.748215+0000","last_fullsized":"2024-09-11T08:18:08.748215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472237+0000","last_change":"2024-09-11T08:18:00.520790+0000","last_active":"2024-09-11T08:18:09.472237+0000","last_peered":"2024-09-11T08:18:09.472237+0000","last_clean":"2024-09-11T08:18:09.472237+0000","last_became_active":"2024-09-11T08:18:00.520020+0000","last_became_peered":"2024-09-11T08:18:00.520020+0000","last_unstale":"2024-09-11T08:18:09.472237+0000","last_undegraded":"2024-09-11T08:18:09.472237+0000","last_fullsized":"2024-09-11T08:18:09.472237+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:12:04.632464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748072+0000","last_change":"2024-09-11T08:17:58.362039+0000","last_active":"2024-09-11T08:18:08.748072+0000","last_peered":"2024-09-11T08:18:08.748072+0000","last_clean":"2024-09-11T08:18:08.748072+0000","last_became_active":"2024-09-11T08:17:58.361763+0000","last_became_peered":"2024-09-11T08:17:58.361763+0000","last_unstale":"2024-09-11T08:18:08.748072+0000","last_undegraded":"2024-09-11T08:18:08.748072+0000","last_fullsized":"2024-09-11T08:18:08.748072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:54.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459541+0000","last_change":"2024-09-11T08:18:02.397916+0000","last_active":"2024-09-11T08:19:16.459541+0000","last_peered":"2024-09-11T08:19:16.459541+0000","last_clean":"2024-09-11T08:19:16.459541+0000","last_became_active":"2024-09-11T08:18:02.397534+0000","last_became_peered":"2024-09-11T08:18:02.397534+0000","last_unstale":"2024-09-11T08:19:16.459541+0000","last_undegraded":"2024-09-11T08:19:16.459541+0000","last_fullsized":"2024-09-11T08:19:16.459541+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:35.783024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743968+0000","last_change":"2024-09-11T08:18:04.405974+0000","last_active":"2024-09-11T08:18:08.743968+0000","last_peered":"2024-09-11T08:18:08.743968+0000","last_clean":"2024-09-11T08:18:08.743968+0000","last_became_active":"2024-09-11T08:18:04.405707+0000","last_became_peered":"2024-09-11T08:18:04.405707+0000","last_unstale":"2024-09-11T08:18:08.743968+0000","last_undegraded":"2024-09-11T08:18:08.743968+0000","last_fullsized":"2024-09-11T08:18:08.743968+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:02.611151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472706+0000","last_change":"2024-09-11T08:18:00.379512+0000","last_active":"2024-09-11T08:18:09.472706+0000","last_peered":"2024-09-11T08:18:09.472706+0000","last_clean":"2024-09-11T08:18:09.472706+0000","last_became_active":"2024-09-11T08:18:00.379223+0000","last_became_peered":"2024-09-11T08:18:00.379223+0000","last_unstale":"2024-09-11T08:18:09.472706+0000","last_undegraded":"2024-09-11T08:18:09.472706+0000","last_fullsized":"2024-09-11T08:18:09.472706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:47:42.679988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382175+0000","last_change":"2024-09-11T08:17:58.362209+0000","last_active":"2024-09-11T08:18:09.382175+0000","last_peered":"2024-09-11T08:18:09.382175+0000","last_clean":"2024-09-11T08:18:09.382175+0000","last_became_active":"2024-09-11T08:17:58.361902+0000","last_became_peered":"2024-09-11T08:17:58.361902+0000","last_unstale":"2024-09-11T08:18:09.382175+0000","last_undegraded":"2024-09-11T08:18:09.382175+0000","last_fullsized":"2024-09-11T08:18:09.382175+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:01.286395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076678+0000","last_change":"2024-09-11T08:18:02.393465+0000","last_active":"2024-09-11T08:18:09.076678+0000","last_peered":"2024-09-11T08:18:09.076678+0000","last_clean":"2024-09-11T08:18:09.076678+0000","last_became_active":"2024-09-11T08:18:02.393170+0000","last_became_peered":"2024-09-11T08:18:02.393170+0000","last_unstale":"2024-09-11T08:18:09.076678+0000","last_undegraded":"2024-09-11T08:18:09.076678+0000","last_fullsized":"2024-09-11T08:18:09.076678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:55:26.563148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747304+0000","last_change":"2024-09-11T08:18:04.414431+0000","last_active":"2024-09-11T08:18:08.747304+0000","last_peered":"2024-09-11T08:18:08.747304+0000","last_clean":"2024-09-11T08:18:08.747304+0000","last_became_active":"2024-09-11T08:18:04.413988+0000","last_became_peered":"2024-09-11T08:18:04.413988+0000","last_unstale":"2024-09-11T08:18:08.747304+0000","last_undegraded":"2024-09-11T08:18:08.747304+0000","last_fullsized":"2024-09-11T08:18:08.747304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:31.866938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743546+0000","last_change":"2024-09-11T08:18:00.379696+0000","last_active":"2024-09-11T08:18:08.743546+0000","last_peered":"2024-09-11T08:18:08.743546+0000","last_clean":"2024-09-11T08:18:08.743546+0000","last_became_active":"2024-09-11T08:18:00.379020+0000","last_became_peered":"2024-09-11T08:18:00.379020+0000","last_unstale":"2024-09-11T08:18:08.743546+0000","last_undegraded":"2024-09-11T08:18:08.743546+0000","last_fullsized":"2024-09-11T08:18:08.743546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:56.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473214+0000","last_change":"2024-09-11T08:17:58.357853+0000","last_active":"2024-09-11T08:18:09.473214+0000","last_peered":"2024-09-11T08:18:09.473214+0000","last_clean":"2024-09-11T08:18:09.473214+0000","last_became_active":"2024-09-11T08:17:58.357576+0000","last_became_peered":"2024-09-11T08:17:58.357576+0000","last_unstale":"2024-09-11T08:18:09.473214+0000","last_undegraded":"2024-09-11T08:18:09.473214+0000","last_fullsized":"2024-09-11T08:18:09.473214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:19:31.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472518+0000","last_change":"2024-09-11T08:18:02.393837+0000","last_active":"2024-09-11T08:18:09.472518+0000","last_peered":"2024-09-11T08:18:09.472518+0000","last_clean":"2024-09-11T08:18:09.472518+0000","last_became_active":"2024-09-11T08:18:02.393513+0000","last_became_peered":"2024-09-11T08:18:02.393513+0000","last_unstale":"2024-09-11T08:18:09.472518+0000","last_undegraded":"2024-09-11T08:18:09.472518+0000","last_fullsized":"2024-09-11T08:18:09.472518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076417+0000","last_change":"2024-09-11T08:18:04.415005+0000","last_active":"2024-09-11T08:18:09.076417+0000","last_peered":"2024-09-11T08:18:09.076417+0000","last_clean":"2024-09-11T08:18:09.076417+0000","last_became_active":"2024-09-11T08:18:04.414714+0000","last_became_peered":"2024-09-11T08:18:04.414714+0000","last_unstale":"2024-09-11T08:18:09.076417+0000","last_undegraded":"2024-09-11T08:18:09.076417+0000","last_fullsized":"2024-09-11T08:18:09.076417+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:15.184562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076408+0000","last_change":"2024-09-11T08:18:00.385501+0000","last_active":"2024-09-11T08:18:09.076408+0000","last_peered":"2024-09-11T08:18:09.076408+0000","last_clean":"2024-09-11T08:18:09.076408+0000","last_became_active":"2024-09-11T08:18:00.385206+0000","last_became_peered":"2024-09-11T08:18:00.385206+0000","last_unstale":"2024-09-11T08:18:09.076408+0000","last_undegraded":"2024-09-11T08:18:09.076408+0000","last_fullsized":"2024-09-11T08:18:09.076408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:11.792134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472308+0000","last_change":"2024-09-11T08:17:58.363585+0000","last_active":"2024-09-11T08:18:09.472308+0000","last_peered":"2024-09-11T08:18:09.472308+0000","last_clean":"2024-09-11T08:18:09.472308+0000","last_became_active":"2024-09-11T08:17:58.360310+0000","last_became_peered":"2024-09-11T08:17:58.360310+0000","last_unstale":"2024-09-11T08:18:09.472308+0000","last_undegraded":"2024-09-11T08:18:09.472308+0000","last_fullsized":"2024-09-11T08:18:09.472308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:01.264216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.381884+0000","last_change":"2024-09-11T08:18:02.393310+0000","last_active":"2024-09-11T08:18:09.381884+0000","last_peered":"2024-09-11T08:18:09.381884+0000","last_clean":"2024-09-11T08:18:09.381884+0000","last_became_active":"2024-09-11T08:18:02.391772+0000","last_became_peered":"2024-09-11T08:18:02.391772+0000","last_unstale":"2024-09-11T08:18:09.381884+0000","last_undegraded":"2024-09-11T08:18:09.381884+0000","last_fullsized":"2024-09-11T08:18:09.381884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:53.699344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471508+0000","last_change":"2024-09-11T08:18:04.409389+0000","last_active":"2024-09-11T08:18:09.471508+0000","last_peered":"2024-09-11T08:18:09.471508+0000","last_clean":"2024-09-11T08:18:09.471508+0000","last_became_active":"2024-09-11T08:18:04.409047+0000","last_became_peered":"2024-09-11T08:18:04.409047+0000","last_unstale":"2024-09-11T08:18:09.471508+0000","last_undegraded":"2024-09-11T08:18:09.471508+0000","last_fullsized":"2024-09-11T08:18:09.471508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:57.143676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076522+0000","last_change":"2024-09-11T08:18:00.520032+0000","last_active":"2024-09-11T08:18:09.076522+0000","last_peered":"2024-09-11T08:18:09.076522+0000","last_clean":"2024-09-11T08:18:09.076522+0000","last_became_active":"2024-09-11T08:18:00.519760+0000","last_became_peered":"2024-09-11T08:18:00.519760+0000","last_unstale":"2024-09-11T08:18:09.076522+0000","last_undegraded":"2024-09-11T08:18:09.076522+0000","last_fullsized":"2024-09-11T08:18:09.076522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:31.996641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382407+0000","last_change":"2024-09-11T08:17:58.357614+0000","last_active":"2024-09-11T08:18:09.382407+0000","last_peered":"2024-09-11T08:18:09.382407+0000","last_clean":"2024-09-11T08:18:09.382407+0000","last_became_active":"2024-09-11T08:17:58.357337+0000","last_became_peered":"2024-09-11T08:17:58.357337+0000","last_unstale":"2024-09-11T08:18:09.382407+0000","last_undegraded":"2024-09-11T08:18:09.382407+0000","last_fullsized":"2024-09-11T08:18:09.382407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:04.284963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471270+0000","last_change":"2024-09-11T08:18:02.392015+0000","last_active":"2024-09-11T08:18:09.471270+0000","last_peered":"2024-09-11T08:18:09.471270+0000","last_clean":"2024-09-11T08:18:09.471270+0000","last_became_active":"2024-09-11T08:18:02.390703+0000","last_became_peered":"2024-09-11T08:18:02.390703+0000","last_unstale":"2024-09-11T08:18:09.471270+0000","last_undegraded":"2024-09-11T08:18:09.471270+0000","last_fullsized":"2024-09-11T08:18:09.471270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:01.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076563+0000","last_change":"2024-09-11T08:18:04.443943+0000","last_active":"2024-09-11T08:18:09.076563+0000","last_peered":"2024-09-11T08:18:09.076563+0000","last_clean":"2024-09-11T08:18:09.076563+0000","last_became_active":"2024-09-11T08:18:04.443660+0000","last_became_peered":"2024-09-11T08:18:04.443660+0000","last_unstale":"2024-09-11T08:18:09.076563+0000","last_undegraded":"2024-09-11T08:18:09.076563+0000","last_fullsized":"2024-09-11T08:18:09.076563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.746864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472228+0000","last_change":"2024-09-11T08:18:04.410052+0000","last_active":"2024-09-11T08:18:09.472228+0000","last_peered":"2024-09-11T08:18:09.472228+0000","last_clean":"2024-09-11T08:18:09.472228+0000","last_became_active":"2024-09-11T08:18:04.409768+0000","last_became_peered":"2024-09-11T08:18:04.409768+0000","last_unstale":"2024-09-11T08:18:09.472228+0000","last_undegraded":"2024-09-11T08:18:09.472228+0000","last_fullsized":"2024-09-11T08:18:09.472228+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:50:33.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471233+0000","last_change":"2024-09-11T08:17:58.361806+0000","last_active":"2024-09-11T08:18:09.471233+0000","last_peered":"2024-09-11T08:18:09.471233+0000","last_clean":"2024-09-11T08:18:09.471233+0000","last_became_active":"2024-09-11T08:17:58.361523+0000","last_became_peered":"2024-09-11T08:17:58.361523+0000","last_unstale":"2024-09-11T08:18:09.471233+0000","last_undegraded":"2024-09-11T08:18:09.471233+0000","last_fullsized":"2024-09-11T08:18:09.471233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:58:08.207346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748339+0000","last_change":"2024-09-11T08:18:00.521128+0000","last_active":"2024-09-11T08:18:08.748339+0000","last_peered":"2024-09-11T08:18:08.748339+0000","last_clean":"2024-09-11T08:18:08.748339+0000","last_became_active":"2024-09-11T08:18:00.520872+0000","last_became_peered":"2024-09-11T08:18:00.520872+0000","last_unstale":"2024-09-11T08:18:08.748339+0000","last_undegraded":"2024-09-11T08:18:08.748339+0000","last_fullsized":"2024-09-11T08:18:08.748339+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:55:48.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:16.459690+0000","last_change":"2024-09-11T08:18:02.393162+0000","last_active":"2024-09-11T08:19:16.459690+0000","last_peered":"2024-09-11T08:19:16.459690+0000","last_clean":"2024-09-11T08:19:16.459690+0000","last_became_active":"2024-09-11T08:18:02.390577+0000","last_became_peered":"2024-09-11T08:18:02.390577+0000","last_unstale":"2024-09-11T08:19:16.459690+0000","last_undegraded":"2024-09-11T08:19:16.459690+0000","last_fullsized":"2024-09-11T08:19:16.459690+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:40.325762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472368+0000","last_change":"2024-09-11T08:18:04.410713+0000","last_active":"2024-09-11T08:18:09.472368+0000","last_peered":"2024-09-11T08:18:09.472368+0000","last_clean":"2024-09-11T08:18:09.472368+0000","last_became_active":"2024-09-11T08:18:04.410369+0000","last_became_peered":"2024-09-11T08:18:04.410369+0000","last_unstale":"2024-09-11T08:18:09.472368+0000","last_undegraded":"2024-09-11T08:18:09.472368+0000","last_fullsized":"2024-09-11T08:18:09.472368+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:03.047857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076804+0000","last_change":"2024-09-11T08:17:58.362638+0000","last_active":"2024-09-11T08:18:09.076804+0000","last_peered":"2024-09-11T08:18:09.076804+0000","last_clean":"2024-09-11T08:18:09.076804+0000","last_became_active":"2024-09-11T08:17:58.362371+0000","last_became_peered":"2024-09-11T08:17:58.362371+0000","last_unstale":"2024-09-11T08:18:09.076804+0000","last_undegraded":"2024-09-11T08:18:09.076804+0000","last_fullsized":"2024-09-11T08:18:09.076804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:05:22.393730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382390+0000","last_change":"2024-09-11T08:18:00.377240+0000","last_active":"2024-09-11T08:18:09.382390+0000","last_peered":"2024-09-11T08:18:09.382390+0000","last_clean":"2024-09-11T08:18:09.382390+0000","last_became_active":"2024-09-11T08:18:00.376909+0000","last_became_peered":"2024-09-11T08:18:00.376909+0000","last_unstale":"2024-09-11T08:18:09.382390+0000","last_undegraded":"2024-09-11T08:18:09.382390+0000","last_fullsized":"2024-09-11T08:18:09.382390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:08.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748286+0000","last_change":"2024-09-11T08:18:02.391686+0000","last_active":"2024-09-11T08:18:08.748286+0000","last_peered":"2024-09-11T08:18:08.748286+0000","last_clean":"2024-09-11T08:18:08.748286+0000","last_became_active":"2024-09-11T08:18:02.391385+0000","last_became_peered":"2024-09-11T08:18:02.391385+0000","last_unstale":"2024-09-11T08:18:08.748286+0000","last_undegraded":"2024-09-11T08:18:08.748286+0000","last_fullsized":"2024-09-11T08:18:08.748286+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:11.689121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743873+0000","last_change":"2024-09-11T08:18:04.443059+0000","last_active":"2024-09-11T08:18:08.743873+0000","last_peered":"2024-09-11T08:18:08.743873+0000","last_clean":"2024-09-11T08:18:08.743873+0000","last_became_active":"2024-09-11T08:18:04.442687+0000","last_became_peered":"2024-09-11T08:18:04.442687+0000","last_unstale":"2024-09-11T08:18:08.743873+0000","last_undegraded":"2024-09-11T08:18:08.743873+0000","last_fullsized":"2024-09-11T08:18:08.743873+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:24:31.764095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"53'1","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382260+0000","last_change":"2024-09-11T08:17:58.363183+0000","last_active":"2024-09-11T08:18:09.382260+0000","last_peered":"2024-09-11T08:18:09.382260+0000","last_clean":"2024-09-11T08:18:09.382260+0000","last_became_active":"2024-09-11T08:17:58.362916+0000","last_became_peered":"2024-09-11T08:17:58.362916+0000","last_unstale":"2024-09-11T08:18:09.382260+0000","last_undegraded":"2024-09-11T08:18:09.382260+0000","last_fullsized":"2024-09-11T08:18:09.382260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:26:54.479483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472468+0000","last_change":"2024-09-11T08:18:00.382812+0000","last_active":"2024-09-11T08:18:09.472468+0000","last_peered":"2024-09-11T08:18:09.472468+0000","last_clean":"2024-09-11T08:18:09.472468+0000","last_became_active":"2024-09-11T08:18:00.382533+0000","last_became_peered":"2024-09-11T08:18:00.382533+0000","last_unstale":"2024-09-11T08:18:09.472468+0000","last_undegraded":"2024-09-11T08:18:09.472468+0000","last_fullsized":"2024-09-11T08:18:09.472468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:27.840035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473043+0000","last_change":"2024-09-11T08:18:02.393411+0000","last_active":"2024-09-11T08:18:09.473043+0000","last_peered":"2024-09-11T08:18:09.473043+0000","last_clean":"2024-09-11T08:18:09.473043+0000","last_became_active":"2024-09-11T08:18:02.393026+0000","last_became_peered":"2024-09-11T08:18:02.393026+0000","last_unstale":"2024-09-11T08:18:09.473043+0000","last_undegraded":"2024-09-11T08:18:09.473043+0000","last_fullsized":"2024-09-11T08:18:09.473043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:55:44.238671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077130+0000","last_change":"2024-09-11T08:18:04.443724+0000","last_active":"2024-09-11T08:18:09.077130+0000","last_peered":"2024-09-11T08:18:09.077130+0000","last_clean":"2024-09-11T08:18:09.077130+0000","last_became_active":"2024-09-11T08:18:04.443379+0000","last_became_peered":"2024-09-11T08:18:04.443379+0000","last_unstale":"2024-09-11T08:18:09.077130+0000","last_undegraded":"2024-09-11T08:18:09.077130+0000","last_fullsized":"2024-09-11T08:18:09.077130+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:09:42.355636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077172+0000","last_change":"2024-09-11T08:17:58.365234+0000","last_active":"2024-09-11T08:18:09.077172+0000","last_peered":"2024-09-11T08:18:09.077172+0000","last_clean":"2024-09-11T08:18:09.077172+0000","last_became_active":"2024-09-11T08:17:58.364962+0000","last_became_peered":"2024-09-11T08:17:58.364962+0000","last_unstale":"2024-09-11T08:18:09.077172+0000","last_undegraded":"2024-09-11T08:18:09.077172+0000","last_fullsized":"2024-09-11T08:18:09.077172+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:57.179380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'12","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077156+0000","last_change":"2024-09-11T08:18:00.384460+0000","last_active":"2024-09-11T08:18:09.077156+0000","last_peered":"2024-09-11T08:18:09.077156+0000","last_clean":"2024-09-11T08:18:09.077156+0000","last_became_active":"2024-09-11T08:18:00.384165+0000","last_became_peered":"2024-09-11T08:18:00.384165+0000","last_unstale":"2024-09-11T08:18:09.077156+0000","last_undegraded":"2024-09-11T08:18:09.077156+0000","last_fullsized":"2024-09-11T08:18:09.077156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:55.602639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743622+0000","last_change":"2024-09-11T08:18:02.397134+0000","last_active":"2024-09-11T08:18:08.743622+0000","last_peered":"2024-09-11T08:18:08.743622+0000","last_clean":"2024-09-11T08:18:08.743622+0000","last_became_active":"2024-09-11T08:18:02.396814+0000","last_became_peered":"2024-09-11T08:18:02.396814+0000","last_unstale":"2024-09-11T08:18:08.743622+0000","last_undegraded":"2024-09-11T08:18:08.743622+0000","last_fullsized":"2024-09-11T08:18:08.743622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:27.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1328,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397526,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298604,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446548,"statfs":{"total":95995035648,"available":95689265152,"internally_reserved":0,"allocated":1282048,"data_stored":871734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.72599999999999998}]},{"osd":2,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.746},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63100000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593755,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298580,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446572,"statfs":{"total":95995035648,"available":95689289728,"internally_reserved":0,"allocated":1257472,"data_stored":870028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.62,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39300000000000002}]},{"osd":1,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.48199999999999998}]},{"osd":2,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.63800000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70699999999999996,"5min":0.753,"15min":0.753},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.627}]},{"osd":7,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60999999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298004,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447148,"statfs":{"total":95995035648,"available":95689879552,"internally_reserved":0,"allocated":663552,"data_stored":279176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49199999999999999,"15min":0.495},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60599999999999998,"5min":0.751,"15min":0.751},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65300000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.495},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.63100000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.308}]},{"osd":6,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67400000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.33300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57699999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33300000000000002}]},{"osd":7,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986213,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447120,"statfs":{"total":95995035648,"available":95689850880,"internally_reserved":0,"allocated":692224,"data_stored":280356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.745},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49099999999999999,"15min":0.495},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58799999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.499,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Wed Sep 11 08:19:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.443,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Sep 11 08:18:24 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.621},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.59299999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149737,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298040,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447112,"statfs":{"total":95995035648,"available":95689842688,"internally_reserved":0,"allocated":700416,"data_stored":280891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44900000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.40600000000000003,"15min":0.42799999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47199999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39600000000000002,"15min":0.41399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52400000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.371}]},{"osd":2,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.49299999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.504,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.30199999999999999}]},{"osd":4,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64200000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Sep 11 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68600000000000005}]},{"osd":7,"last update":"Wed Sep 11 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58499999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298004,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447148,"statfs":{"total":95995035648,"available":95689879552,"internally_reserved":0,"allocated":663552,"data_stored":279971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Sep 11 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39600000000000002,"15min":0.40300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.28999999999999998}]},{"osd":3,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.375},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed Sep 11 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Sep 11 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.434},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.497}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.443},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298064,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447088,"statfs":{"total":95995035648,"available":95689818112,"internally_reserved":0,"allocated":724992,"data_stored":282029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35299999999999998,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.218,"15min":0.218},"max":{"1min":0.52600000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Sep 11 08:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.497}]},{"osd":3,"last update":"Wed Sep 11 08:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.498,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Sep 11 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Sep 11 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76200000000000001}]},{"osd":6,"last update":"Wed Sep 11 08:19:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed Sep 11 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.75}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298596,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446556,"statfs":{"total":95995035648,"available":95689273344,"internally_reserved":0,"allocated":1273856,"data_stored":870195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 11 08:18:30 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.33000000000000002,"15min":0.30599999999999999},"min":{"1min":0.222,"5min":0.218,"15min":0.218},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Sep 11 08:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.379},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.371},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.503,"5min":0.625,"15min":0.625},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Sep 11 08:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52100000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35099999999999998}]},{"osd":4,"last update":"Wed Sep 11 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Sep 11 08:19:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.747,"15min":0.747},"last":0.501},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48899999999999999}]},{"osd":6,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.434}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T08:19:29.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T08:19:29.399 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:29.594 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:29 smithi175 bash[65986]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-11T08:19:29.594 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:29 smithi175 bash[65986]: Writing manifest to image destination 2024-09-11T08:19:30.021 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:29 smithi175 podman[65986]: 2024-09-11 08:19:29.70460289 +0000 UTC m=+2.287314155 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-11T08:19:30.022 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:29 smithi175 podman[65986]: 2024-09-11 08:19:29.794875501 +0000 UTC m=+2.377586763 container create 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:30.345 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 podman[65986]: 2024-09-11 08:19:30.021646388 +0000 UTC m=+2.604357651 container init 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:19:30.345 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 podman[65986]: 2024-09-11 08:19:30.026640335 +0000 UTC m=+2.609351597 container start 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:19:30.345 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.030Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.030Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.031Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.031Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.031Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.031Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=arp 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-11T08:19:30.346 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=edac 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-11T08:19:30.347 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=os 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-11T08:19:30.348 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=stat 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=time 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=uname 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b[66060]: ts=2024-09-11T08:19:30.032Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 bash[65986]: 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 2024-09-11T08:19:30.349 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:19:30 smithi175 systemd[1]: Started Ceph node-exporter.b for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:30.641 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:30.641 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:30.641 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.641 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.641 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:30.642 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:30 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 -- 172.21.15.173:0/3008943064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fc8a0 msgr2=0x7f26ec0fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/3008943064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fc8a0 0x7f26ec0fcd10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26d4004980 tx=0x7f26d4009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 -- 172.21.15.173:0/3008943064 shutdown_connections 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/3008943064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fd250 0x7f26ec109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/3008943064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fc8a0 0x7f26ec0fcd10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/3008943064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 -- 172.21.15.173:0/3008943064 >> 172.21.15.173:0/3008943064 conn(0x7f26ec0f8400 msgr2=0x7f26ec0fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 -- 172.21.15.173:0/3008943064 shutdown_connections 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 -- 172.21.15.173:0/3008943064 wait complete. 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.150+0000 7f26f0ca4640 1 Processor -- start 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 -- start start 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fc8a0 0x7f26ec114e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec10eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec10f640 con 0x7f26ec1028c0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec10f7b0 con 0x7f26ec0fc8a0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26f0ca4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec10f970 con 0x7f26ec0fd250 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec10eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:56700/0 (socket says 172.21.15.173:56700) 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26e3fff640 1 -- 172.21.15.173:0/157656489 learned_addr learned my addr 172.21.15.173:0/157656489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ea59c640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fc8a0 0x7f26ec114e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 -- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 msgr2=0x7f26ec1153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 -- 172.21.15.173:0/157656489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fc8a0 msgr2=0x7f26ec114e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fc8a0 0x7f26ec114e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 -- 172.21.15.173:0/157656489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc005040 con 0x7f26ec1028c0 2024-09-11T08:19:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26e3fff640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26ead9d640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec10eff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c910 tx=0x7f26e4007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.151+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400cea0 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.152+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f26e400ac90 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.152+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d4005040 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.152+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4012b30 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.152+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec11bcb0 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.153+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec0fdfe0 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.153+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f26e400a850 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.154+0000 7f26e2ffd640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 0x7f26d80713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.154+0000 7f26ea59c640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 0x7f26d80713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.154+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f26e408ed50 con 0x7f26ec1028c0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.154+0000 7f26ea59c640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 0x7f26d80713c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26dc004a50 tx=0x7f26dc00b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.158+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f26e4092030 con 0x7f26ec1028c0 2024-09-11T08:19:31.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.327+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 --> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26ec10bbd0 con 0x7f26d806ef10 2024-09-11T08:19:31.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.336+0000 7f26e2ffd640 1 -- 172.21.15.173:0/157656489 <== mgr.14556 v2:172.21.15.173:6800/2824501820 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+384039 (secure 0 0 0) 0x7f26ec10bbd0 con 0x7f26d806ef10 2024-09-11T08:19:31.340 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:19:31.342 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 msgr2=0x7f26d80713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 0x7f26d80713c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26dc004a50 tx=0x7f26dc00b040 comp rx=0 tx=0).stop 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 msgr2=0x7f26ec10eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec10eff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c910 tx=0x7f26e4007cf0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 shutdown_connections 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f26d806ef10 0x7f26d80713c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26ec1028c0 0x7f26ec10eff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26ec0fd250 0x7f26ec1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 --2- 172.21.15.173:0/157656489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26ec0fc8a0 0x7f26ec114e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 >> 172.21.15.173:0/157656489 conn(0x7f26ec0f8400 msgr2=0x7f26ec0f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 shutdown_connections 2024-09-11T08:19:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:31.340+0000 7f26f0ca4640 1 -- 172.21.15.173:0/157656489 wait complete. 2024-09-11T08:19:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:32 smithi175 ceph-mon[32813]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:32 smithi173 ceph-mon[29664]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:32 smithi173 ceph-mon[40835]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:32.767 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-11T08:19:30.712003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596188,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":938,"num_read_kb":795,"num_write":543,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":548,"ondisk_log_size":548,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2385924,"kb_used_data":7088,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":747575292,"statfs":{"total":767960285184,"available":765517099008,"internally_reserved":0,"allocated":7258112,"data_stored":4014380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002905"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076531+0000","last_change":"2024-09-11T08:18:04.443964+0000","last_active":"2024-09-11T08:18:09.076531+0000","last_peered":"2024-09-11T08:18:09.076531+0000","last_clean":"2024-09-11T08:18:09.076531+0000","last_became_active":"2024-09-11T08:18:04.443685+0000","last_became_peered":"2024-09-11T08:18:04.443685+0000","last_unstale":"2024-09-11T08:18:09.076531+0000","last_undegraded":"2024-09-11T08:18:09.076531+0000","last_fullsized":"2024-09-11T08:18:09.076531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:52.667343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748361+0000","last_change":"2024-09-11T08:17:58.366730+0000","last_active":"2024-09-11T08:18:08.748361+0000","last_peered":"2024-09-11T08:18:08.748361+0000","last_clean":"2024-09-11T08:18:08.748361+0000","last_became_active":"2024-09-11T08:17:58.366441+0000","last_became_peered":"2024-09-11T08:17:58.366441+0000","last_unstale":"2024-09-11T08:18:08.748361+0000","last_undegraded":"2024-09-11T08:18:08.748361+0000","last_fullsized":"2024-09-11T08:18:08.748361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:31.697163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077044+0000","last_change":"2024-09-11T08:18:00.384684+0000","last_active":"2024-09-11T08:18:09.077044+0000","last_peered":"2024-09-11T08:18:09.077044+0000","last_clean":"2024-09-11T08:18:09.077044+0000","last_became_active":"2024-09-11T08:18:00.384300+0000","last_became_peered":"2024-09-11T08:18:00.384300+0000","last_unstale":"2024-09-11T08:18:09.077044+0000","last_undegraded":"2024-09-11T08:18:09.077044+0000","last_fullsized":"2024-09-11T08:18:09.077044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:40.768400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743289+0000","last_change":"2024-09-11T08:18:02.391581+0000","last_active":"2024-09-11T08:18:08.743289+0000","last_peered":"2024-09-11T08:18:08.743289+0000","last_clean":"2024-09-11T08:18:08.743289+0000","last_became_active":"2024-09-11T08:18:02.391203+0000","last_became_peered":"2024-09-11T08:18:02.391203+0000","last_unstale":"2024-09-11T08:18:08.743289+0000","last_undegraded":"2024-09-11T08:18:08.743289+0000","last_fullsized":"2024-09-11T08:18:08.743289+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:02.456323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077232+0000","last_change":"2024-09-11T08:17:58.365401+0000","last_active":"2024-09-11T08:18:09.077232+0000","last_peered":"2024-09-11T08:18:09.077232+0000","last_clean":"2024-09-11T08:18:09.077232+0000","last_became_active":"2024-09-11T08:17:58.365112+0000","last_became_peered":"2024-09-11T08:17:58.365112+0000","last_unstale":"2024-09-11T08:18:09.077232+0000","last_undegraded":"2024-09-11T08:18:09.077232+0000","last_fullsized":"2024-09-11T08:18:09.077232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:16:23.037779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743299+0000","last_change":"2024-09-11T08:18:00.379340+0000","last_active":"2024-09-11T08:18:08.743299+0000","last_peered":"2024-09-11T08:18:08.743299+0000","last_clean":"2024-09-11T08:18:08.743299+0000","last_became_active":"2024-09-11T08:18:00.378999+0000","last_became_peered":"2024-09-11T08:18:00.378999+0000","last_unstale":"2024-09-11T08:18:08.743299+0000","last_undegraded":"2024-09-11T08:18:08.743299+0000","last_fullsized":"2024-09-11T08:18:08.743299+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:28.134385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472123+0000","last_change":"2024-09-11T08:18:02.392358+0000","last_active":"2024-09-11T08:18:09.472123+0000","last_peered":"2024-09-11T08:18:09.472123+0000","last_clean":"2024-09-11T08:18:09.472123+0000","last_became_active":"2024-09-11T08:18:02.392050+0000","last_became_peered":"2024-09-11T08:18:02.392050+0000","last_unstale":"2024-09-11T08:18:09.472123+0000","last_undegraded":"2024-09-11T08:18:09.472123+0000","last_fullsized":"2024-09-11T08:18:09.472123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:00.106926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743349+0000","last_change":"2024-09-11T08:18:04.409519+0000","last_active":"2024-09-11T08:18:08.743349+0000","last_peered":"2024-09-11T08:18:08.743349+0000","last_clean":"2024-09-11T08:18:08.743349+0000","last_became_active":"2024-09-11T08:18:04.409278+0000","last_became_peered":"2024-09-11T08:18:04.409278+0000","last_unstale":"2024-09-11T08:18:08.743349+0000","last_undegraded":"2024-09-11T08:18:08.743349+0000","last_fullsized":"2024-09-11T08:18:08.743349+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:52.241128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472799+0000","last_change":"2024-09-11T08:17:58.365437+0000","last_active":"2024-09-11T08:18:09.472799+0000","last_peered":"2024-09-11T08:18:09.472799+0000","last_clean":"2024-09-11T08:18:09.472799+0000","last_became_active":"2024-09-11T08:17:58.365179+0000","last_became_peered":"2024-09-11T08:17:58.365179+0000","last_unstale":"2024-09-11T08:18:09.472799+0000","last_undegraded":"2024-09-11T08:18:09.472799+0000","last_fullsized":"2024-09-11T08:18:09.472799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:56.731980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'5","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743544+0000","last_change":"2024-09-11T08:18:00.379507+0000","last_active":"2024-09-11T08:18:08.743544+0000","last_peered":"2024-09-11T08:18:08.743544+0000","last_clean":"2024-09-11T08:18:08.743544+0000","last_became_active":"2024-09-11T08:18:00.379085+0000","last_became_peered":"2024-09-11T08:18:00.379085+0000","last_unstale":"2024-09-11T08:18:08.743544+0000","last_undegraded":"2024-09-11T08:18:08.743544+0000","last_fullsized":"2024-09-11T08:18:08.743544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:53:02.554718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472212+0000","last_change":"2024-09-11T08:18:02.388936+0000","last_active":"2024-09-11T08:18:09.472212+0000","last_peered":"2024-09-11T08:18:09.472212+0000","last_clean":"2024-09-11T08:18:09.472212+0000","last_became_active":"2024-09-11T08:18:02.388654+0000","last_became_peered":"2024-09-11T08:18:02.388654+0000","last_unstale":"2024-09-11T08:18:09.472212+0000","last_undegraded":"2024-09-11T08:18:09.472212+0000","last_fullsized":"2024-09-11T08:18:09.472212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:44:50.143199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471304+0000","last_change":"2024-09-11T08:18:04.415319+0000","last_active":"2024-09-11T08:18:09.471304+0000","last_peered":"2024-09-11T08:18:09.471304+0000","last_clean":"2024-09-11T08:18:09.471304+0000","last_became_active":"2024-09-11T08:18:04.415019+0000","last_became_peered":"2024-09-11T08:18:04.415019+0000","last_unstale":"2024-09-11T08:18:09.471304+0000","last_undegraded":"2024-09-11T08:18:09.471304+0000","last_fullsized":"2024-09-11T08:18:09.471304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:12.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472492+0000","last_change":"2024-09-11T08:17:58.360969+0000","last_active":"2024-09-11T08:18:09.472492+0000","last_peered":"2024-09-11T08:18:09.472492+0000","last_clean":"2024-09-11T08:18:09.472492+0000","last_became_active":"2024-09-11T08:17:58.360256+0000","last_became_peered":"2024-09-11T08:17:58.360256+0000","last_unstale":"2024-09-11T08:18:09.472492+0000","last_undegraded":"2024-09-11T08:18:09.472492+0000","last_fullsized":"2024-09-11T08:18:09.472492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:25.101733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743566+0000","last_change":"2024-09-11T08:18:00.382068+0000","last_active":"2024-09-11T08:18:08.743566+0000","last_peered":"2024-09-11T08:18:08.743566+0000","last_clean":"2024-09-11T08:18:08.743566+0000","last_became_active":"2024-09-11T08:18:00.381710+0000","last_became_peered":"2024-09-11T08:18:00.381710+0000","last_unstale":"2024-09-11T08:18:08.743566+0000","last_undegraded":"2024-09-11T08:18:08.743566+0000","last_fullsized":"2024-09-11T08:18:08.743566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:57.386855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471608+0000","last_change":"2024-09-11T08:18:02.392616+0000","last_active":"2024-09-11T08:18:09.471608+0000","last_peered":"2024-09-11T08:18:09.471608+0000","last_clean":"2024-09-11T08:18:09.471608+0000","last_became_active":"2024-09-11T08:18:02.392303+0000","last_became_peered":"2024-09-11T08:18:02.392303+0000","last_unstale":"2024-09-11T08:18:09.471608+0000","last_undegraded":"2024-09-11T08:18:09.471608+0000","last_fullsized":"2024-09-11T08:18:09.471608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:52.481460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747432+0000","last_change":"2024-09-11T08:18:04.414748+0000","last_active":"2024-09-11T08:18:08.747432+0000","last_peered":"2024-09-11T08:18:08.747432+0000","last_clean":"2024-09-11T08:18:08.747432+0000","last_became_active":"2024-09-11T08:18:04.414467+0000","last_became_peered":"2024-09-11T08:18:04.414467+0000","last_unstale":"2024-09-11T08:18:08.747432+0000","last_undegraded":"2024-09-11T08:18:08.747432+0000","last_fullsized":"2024-09-11T08:18:08.747432+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:23.110007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":44,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743938+0000","last_change":"2024-09-11T08:18:00.379467+0000","last_active":"2024-09-11T08:18:08.743938+0000","last_peered":"2024-09-11T08:18:08.743938+0000","last_clean":"2024-09-11T08:18:08.743938+0000","last_became_active":"2024-09-11T08:18:00.379173+0000","last_became_peered":"2024-09-11T08:18:00.379173+0000","last_unstale":"2024-09-11T08:18:08.743938+0000","last_undegraded":"2024-09-11T08:18:08.743938+0000","last_fullsized":"2024-09-11T08:18:08.743938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:57.452722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472126+0000","last_change":"2024-09-11T08:17:58.358144+0000","last_active":"2024-09-11T08:18:09.472126+0000","last_peered":"2024-09-11T08:18:09.472126+0000","last_clean":"2024-09-11T08:18:09.472126+0000","last_became_active":"2024-09-11T08:17:58.357703+0000","last_became_peered":"2024-09-11T08:17:58.357703+0000","last_unstale":"2024-09-11T08:18:09.472126+0000","last_undegraded":"2024-09-11T08:18:09.472126+0000","last_fullsized":"2024-09-11T08:18:09.472126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472363+0000","last_change":"2024-09-11T08:18:02.391460+0000","last_active":"2024-09-11T08:18:09.472363+0000","last_peered":"2024-09-11T08:18:09.472363+0000","last_clean":"2024-09-11T08:18:09.472363+0000","last_became_active":"2024-09-11T08:18:02.391155+0000","last_became_peered":"2024-09-11T08:18:02.391155+0000","last_unstale":"2024-09-11T08:18:09.472363+0000","last_undegraded":"2024-09-11T08:18:09.472363+0000","last_fullsized":"2024-09-11T08:18:09.472363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:16.898774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472141+0000","last_change":"2024-09-11T08:18:04.413386+0000","last_active":"2024-09-11T08:18:09.472141+0000","last_peered":"2024-09-11T08:18:09.472141+0000","last_clean":"2024-09-11T08:18:09.472141+0000","last_became_active":"2024-09-11T08:18:04.413121+0000","last_became_peered":"2024-09-11T08:18:04.413121+0000","last_unstale":"2024-09-11T08:18:09.472141+0000","last_undegraded":"2024-09-11T08:18:09.472141+0000","last_fullsized":"2024-09-11T08:18:09.472141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:14.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743719+0000","last_change":"2024-09-11T08:18:00.382153+0000","last_active":"2024-09-11T08:18:08.743719+0000","last_peered":"2024-09-11T08:18:08.743719+0000","last_clean":"2024-09-11T08:18:08.743719+0000","last_became_active":"2024-09-11T08:18:00.381827+0000","last_became_peered":"2024-09-11T08:18:00.381827+0000","last_unstale":"2024-09-11T08:18:08.743719+0000","last_undegraded":"2024-09-11T08:18:08.743719+0000","last_fullsized":"2024-09-11T08:18:08.743719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:33.588014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"53'1","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472907+0000","last_change":"2024-09-11T08:17:58.359805+0000","last_active":"2024-09-11T08:18:09.472907+0000","last_peered":"2024-09-11T08:18:09.472907+0000","last_clean":"2024-09-11T08:18:09.472907+0000","last_became_active":"2024-09-11T08:17:58.359501+0000","last_became_peered":"2024-09-11T08:17:58.359501+0000","last_unstale":"2024-09-11T08:18:09.472907+0000","last_undegraded":"2024-09-11T08:18:09.472907+0000","last_fullsized":"2024-09-11T08:18:09.472907+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:52.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460493+0000","last_change":"2024-09-11T08:18:02.389844+0000","last_active":"2024-09-11T08:19:21.460493+0000","last_peered":"2024-09-11T08:19:21.460493+0000","last_clean":"2024-09-11T08:19:21.460493+0000","last_became_active":"2024-09-11T08:18:02.389553+0000","last_became_peered":"2024-09-11T08:18:02.389553+0000","last_unstale":"2024-09-11T08:19:21.460493+0000","last_undegraded":"2024-09-11T08:19:21.460493+0000","last_fullsized":"2024-09-11T08:19:21.460493+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:59.216806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743806+0000","last_change":"2024-09-11T08:18:04.409514+0000","last_active":"2024-09-11T08:18:08.743806+0000","last_peered":"2024-09-11T08:18:08.743806+0000","last_clean":"2024-09-11T08:18:08.743806+0000","last_became_active":"2024-09-11T08:18:04.409238+0000","last_became_peered":"2024-09-11T08:18:04.409238+0000","last_unstale":"2024-09-11T08:18:08.743806+0000","last_undegraded":"2024-09-11T08:18:08.743806+0000","last_fullsized":"2024-09-11T08:18:08.743806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:12:04.764695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473343+0000","last_change":"2024-09-11T08:18:00.384040+0000","last_active":"2024-09-11T08:18:09.473343+0000","last_peered":"2024-09-11T08:18:09.473343+0000","last_clean":"2024-09-11T08:18:09.473343+0000","last_became_active":"2024-09-11T08:18:00.383722+0000","last_became_peered":"2024-09-11T08:18:00.383722+0000","last_unstale":"2024-09-11T08:18:09.473343+0000","last_undegraded":"2024-09-11T08:18:09.473343+0000","last_fullsized":"2024-09-11T08:18:09.473343+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:40.957858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472273+0000","last_change":"2024-09-11T08:17:58.359168+0000","last_active":"2024-09-11T08:18:09.472273+0000","last_peered":"2024-09-11T08:18:09.472273+0000","last_clean":"2024-09-11T08:18:09.472273+0000","last_became_active":"2024-09-11T08:17:58.358913+0000","last_became_peered":"2024-09-11T08:17:58.358913+0000","last_unstale":"2024-09-11T08:18:09.472273+0000","last_undegraded":"2024-09-11T08:18:09.472273+0000","last_fullsized":"2024-09-11T08:18:09.472273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:44.693010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460570+0000","last_change":"2024-09-11T08:18:02.394595+0000","last_active":"2024-09-11T08:19:21.460570+0000","last_peered":"2024-09-11T08:19:21.460570+0000","last_clean":"2024-09-11T08:19:21.460570+0000","last_became_active":"2024-09-11T08:18:02.394302+0000","last_became_peered":"2024-09-11T08:18:02.394302+0000","last_unstale":"2024-09-11T08:19:21.460570+0000","last_undegraded":"2024-09-11T08:19:21.460570+0000","last_fullsized":"2024-09-11T08:19:21.460570+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:05.821790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472025+0000","last_change":"2024-09-11T08:18:04.411596+0000","last_active":"2024-09-11T08:18:09.472025+0000","last_peered":"2024-09-11T08:18:09.472025+0000","last_clean":"2024-09-11T08:18:09.472025+0000","last_became_active":"2024-09-11T08:18:04.411340+0000","last_became_peered":"2024-09-11T08:18:04.411340+0000","last_unstale":"2024-09-11T08:18:09.472025+0000","last_undegraded":"2024-09-11T08:18:09.472025+0000","last_fullsized":"2024-09-11T08:18:09.472025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:11.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743962+0000","last_change":"2024-09-11T08:18:00.379486+0000","last_active":"2024-09-11T08:18:08.743962+0000","last_peered":"2024-09-11T08:18:08.743962+0000","last_clean":"2024-09-11T08:18:08.743962+0000","last_became_active":"2024-09-11T08:18:00.379131+0000","last_became_peered":"2024-09-11T08:18:00.379131+0000","last_unstale":"2024-09-11T08:18:08.743962+0000","last_undegraded":"2024-09-11T08:18:08.743962+0000","last_fullsized":"2024-09-11T08:18:08.743962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:57.484695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471472+0000","last_change":"2024-09-11T08:17:58.365539+0000","last_active":"2024-09-11T08:18:09.471472+0000","last_peered":"2024-09-11T08:18:09.471472+0000","last_clean":"2024-09-11T08:18:09.471472+0000","last_became_active":"2024-09-11T08:17:58.365159+0000","last_became_peered":"2024-09-11T08:17:58.365159+0000","last_unstale":"2024-09-11T08:18:09.471472+0000","last_undegraded":"2024-09-11T08:18:09.471472+0000","last_fullsized":"2024-09-11T08:18:09.471472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:05:28.474368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472478+0000","last_change":"2024-09-11T08:18:02.389846+0000","last_active":"2024-09-11T08:18:09.472478+0000","last_peered":"2024-09-11T08:18:09.472478+0000","last_clean":"2024-09-11T08:18:09.472478+0000","last_became_active":"2024-09-11T08:18:02.389549+0000","last_became_peered":"2024-09-11T08:18:02.389549+0000","last_unstale":"2024-09-11T08:18:09.472478+0000","last_undegraded":"2024-09-11T08:18:09.472478+0000","last_fullsized":"2024-09-11T08:18:09.472478+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:47:28.732881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076784+0000","last_change":"2024-09-11T08:18:04.442977+0000","last_active":"2024-09-11T08:18:09.076784+0000","last_peered":"2024-09-11T08:18:09.076784+0000","last_clean":"2024-09-11T08:18:09.076784+0000","last_became_active":"2024-09-11T08:18:04.442711+0000","last_became_peered":"2024-09-11T08:18:04.442711+0000","last_unstale":"2024-09-11T08:18:09.076784+0000","last_undegraded":"2024-09-11T08:18:09.076784+0000","last_fullsized":"2024-09-11T08:18:09.076784+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:46:28.531736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"60'14","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743401+0000","last_change":"2024-09-11T08:18:00.375661+0000","last_active":"2024-09-11T08:18:08.743401+0000","last_peered":"2024-09-11T08:18:08.743401+0000","last_clean":"2024-09-11T08:18:08.743401+0000","last_became_active":"2024-09-11T08:18:00.375366+0000","last_became_peered":"2024-09-11T08:18:00.375366+0000","last_unstale":"2024-09-11T08:18:08.743401+0000","last_undegraded":"2024-09-11T08:18:08.743401+0000","last_fullsized":"2024-09-11T08:18:08.743401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:04.636406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382429+0000","last_change":"2024-09-11T08:17:58.363243+0000","last_active":"2024-09-11T08:18:09.382429+0000","last_peered":"2024-09-11T08:18:09.382429+0000","last_clean":"2024-09-11T08:18:09.382429+0000","last_became_active":"2024-09-11T08:17:58.362997+0000","last_became_peered":"2024-09-11T08:17:58.362997+0000","last_unstale":"2024-09-11T08:18:09.382429+0000","last_undegraded":"2024-09-11T08:18:09.382429+0000","last_fullsized":"2024-09-11T08:18:09.382429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:16.696635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460493+0000","last_change":"2024-09-11T08:18:02.394911+0000","last_active":"2024-09-11T08:19:21.460493+0000","last_peered":"2024-09-11T08:19:21.460493+0000","last_clean":"2024-09-11T08:19:21.460493+0000","last_became_active":"2024-09-11T08:18:02.394287+0000","last_became_peered":"2024-09-11T08:18:02.394287+0000","last_unstale":"2024-09-11T08:19:21.460493+0000","last_undegraded":"2024-09-11T08:19:21.460493+0000","last_fullsized":"2024-09-11T08:19:21.460493+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:42.491937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471871+0000","last_change":"2024-09-11T08:18:04.444179+0000","last_active":"2024-09-11T08:18:09.471871+0000","last_peered":"2024-09-11T08:18:09.471871+0000","last_clean":"2024-09-11T08:18:09.471871+0000","last_became_active":"2024-09-11T08:18:04.443823+0000","last_became_peered":"2024-09-11T08:18:04.443823+0000","last_unstale":"2024-09-11T08:18:09.471871+0000","last_undegraded":"2024-09-11T08:18:09.471871+0000","last_fullsized":"2024-09-11T08:18:09.471871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:13.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"60'18","reported_seq":48,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076904+0000","last_change":"2024-09-11T08:18:00.520114+0000","last_active":"2024-09-11T08:18:09.076904+0000","last_peered":"2024-09-11T08:18:09.076904+0000","last_clean":"2024-09-11T08:18:09.076904+0000","last_became_active":"2024-09-11T08:18:00.519777+0000","last_became_peered":"2024-09-11T08:18:00.519777+0000","last_unstale":"2024-09-11T08:18:09.076904+0000","last_undegraded":"2024-09-11T08:18:09.076904+0000","last_fullsized":"2024-09-11T08:18:09.076904+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:18.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473096+0000","last_change":"2024-09-11T08:17:58.357477+0000","last_active":"2024-09-11T08:18:09.473096+0000","last_peered":"2024-09-11T08:18:09.473096+0000","last_clean":"2024-09-11T08:18:09.473096+0000","last_became_active":"2024-09-11T08:17:58.357202+0000","last_became_peered":"2024-09-11T08:17:58.357202+0000","last_unstale":"2024-09-11T08:18:09.473096+0000","last_undegraded":"2024-09-11T08:18:09.473096+0000","last_fullsized":"2024-09-11T08:18:09.473096+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:24:28.595825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743313+0000","last_change":"2024-09-11T08:18:02.394277+0000","last_active":"2024-09-11T08:18:08.743313+0000","last_peered":"2024-09-11T08:18:08.743313+0000","last_clean":"2024-09-11T08:18:08.743313+0000","last_became_active":"2024-09-11T08:18:02.393997+0000","last_became_peered":"2024-09-11T08:18:02.393997+0000","last_unstale":"2024-09-11T08:18:08.743313+0000","last_undegraded":"2024-09-11T08:18:08.743313+0000","last_fullsized":"2024-09-11T08:18:08.743313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:23.834879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743505+0000","last_change":"2024-09-11T08:18:04.413060+0000","last_active":"2024-09-11T08:18:08.743505+0000","last_peered":"2024-09-11T08:18:08.743505+0000","last_clean":"2024-09-11T08:18:08.743505+0000","last_became_active":"2024-09-11T08:18:04.412885+0000","last_became_peered":"2024-09-11T08:18:04.412885+0000","last_unstale":"2024-09-11T08:18:08.743505+0000","last_undegraded":"2024-09-11T08:18:08.743505+0000","last_fullsized":"2024-09-11T08:18:08.743505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:53.486303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"60'19","reported_seq":52,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747973+0000","last_change":"2024-09-11T08:18:00.520224+0000","last_active":"2024-09-11T08:18:08.747973+0000","last_peered":"2024-09-11T08:18:08.747973+0000","last_clean":"2024-09-11T08:18:08.747973+0000","last_became_active":"2024-09-11T08:18:00.519943+0000","last_became_peered":"2024-09-11T08:18:00.519943+0000","last_unstale":"2024-09-11T08:18:08.747973+0000","last_undegraded":"2024-09-11T08:18:08.747973+0000","last_fullsized":"2024-09-11T08:18:08.747973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:44:06.515803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472833+0000","last_change":"2024-09-11T08:17:58.365941+0000","last_active":"2024-09-11T08:18:09.472833+0000","last_peered":"2024-09-11T08:18:09.472833+0000","last_clean":"2024-09-11T08:18:09.472833+0000","last_became_active":"2024-09-11T08:17:58.365396+0000","last_became_peered":"2024-09-11T08:17:58.365396+0000","last_unstale":"2024-09-11T08:18:09.472833+0000","last_undegraded":"2024-09-11T08:18:09.472833+0000","last_fullsized":"2024-09-11T08:18:09.472833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:57.033535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382100+0000","last_change":"2024-09-11T08:18:02.398208+0000","last_active":"2024-09-11T08:18:09.382100+0000","last_peered":"2024-09-11T08:18:09.382100+0000","last_clean":"2024-09-11T08:18:09.382100+0000","last_became_active":"2024-09-11T08:18:02.397878+0000","last_became_peered":"2024-09-11T08:18:02.397878+0000","last_unstale":"2024-09-11T08:18:09.382100+0000","last_undegraded":"2024-09-11T08:18:09.382100+0000","last_fullsized":"2024-09-11T08:18:09.382100+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:20.781427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471965+0000","last_change":"2024-09-11T08:18:04.443766+0000","last_active":"2024-09-11T08:18:09.471965+0000","last_peered":"2024-09-11T08:18:09.471965+0000","last_clean":"2024-09-11T08:18:09.471965+0000","last_became_active":"2024-09-11T08:18:04.443184+0000","last_became_peered":"2024-09-11T08:18:04.443184+0000","last_unstale":"2024-09-11T08:18:09.471965+0000","last_undegraded":"2024-09-11T08:18:09.471965+0000","last_fullsized":"2024-09-11T08:18:09.471965+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:28:34.839105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472811+0000","last_change":"2024-09-11T08:18:00.378363+0000","last_active":"2024-09-11T08:18:09.472811+0000","last_peered":"2024-09-11T08:18:09.472811+0000","last_clean":"2024-09-11T08:18:09.472811+0000","last_became_active":"2024-09-11T08:18:00.377980+0000","last_became_peered":"2024-09-11T08:18:00.377980+0000","last_unstale":"2024-09-11T08:18:09.472811+0000","last_undegraded":"2024-09-11T08:18:09.472811+0000","last_fullsized":"2024-09-11T08:18:09.472811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:31.644068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472786+0000","last_change":"2024-09-11T08:17:58.358513+0000","last_active":"2024-09-11T08:18:09.472786+0000","last_peered":"2024-09-11T08:18:09.472786+0000","last_clean":"2024-09-11T08:18:09.472786+0000","last_became_active":"2024-09-11T08:17:58.358245+0000","last_became_peered":"2024-09-11T08:17:58.358245+0000","last_unstale":"2024-09-11T08:18:09.472786+0000","last_undegraded":"2024-09-11T08:18:09.472786+0000","last_fullsized":"2024-09-11T08:18:09.472786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.405434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460507+0000","last_change":"2024-09-11T08:18:02.390518+0000","last_active":"2024-09-11T08:19:21.460507+0000","last_peered":"2024-09-11T08:19:21.460507+0000","last_clean":"2024-09-11T08:19:21.460507+0000","last_became_active":"2024-09-11T08:18:02.390250+0000","last_became_peered":"2024-09-11T08:18:02.390250+0000","last_unstale":"2024-09-11T08:19:21.460507+0000","last_undegraded":"2024-09-11T08:19:21.460507+0000","last_fullsized":"2024-09-11T08:19:21.460507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:40.353983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747309+0000","last_change":"2024-09-11T08:18:04.417161+0000","last_active":"2024-09-11T08:18:08.747309+0000","last_peered":"2024-09-11T08:18:08.747309+0000","last_clean":"2024-09-11T08:18:08.747309+0000","last_became_active":"2024-09-11T08:18:04.415877+0000","last_became_peered":"2024-09-11T08:18:04.415877+0000","last_unstale":"2024-09-11T08:18:08.747309+0000","last_undegraded":"2024-09-11T08:18:08.747309+0000","last_fullsized":"2024-09-11T08:18:08.747309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:26:21.377950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'28","reported_seq":82,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460492+0000","last_change":"2024-09-11T08:18:00.383911+0000","last_active":"2024-09-11T08:19:21.460492+0000","last_peered":"2024-09-11T08:19:21.460492+0000","last_clean":"2024-09-11T08:19:21.460492+0000","last_became_active":"2024-09-11T08:18:00.383674+0000","last_became_peered":"2024-09-11T08:18:00.383674+0000","last_unstale":"2024-09-11T08:19:21.460492+0000","last_undegraded":"2024-09-11T08:19:21.460492+0000","last_fullsized":"2024-09-11T08:19:21.460492+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:51.237870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472591+0000","last_change":"2024-09-11T08:17:58.356629+0000","last_active":"2024-09-11T08:18:09.472591+0000","last_peered":"2024-09-11T08:18:09.472591+0000","last_clean":"2024-09-11T08:18:09.472591+0000","last_became_active":"2024-09-11T08:17:58.356345+0000","last_became_peered":"2024-09-11T08:17:58.356345+0000","last_unstale":"2024-09-11T08:18:09.472591+0000","last_undegraded":"2024-09-11T08:18:09.472591+0000","last_fullsized":"2024-09-11T08:18:09.472591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:59.617519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748125+0000","last_change":"2024-09-11T08:18:02.389590+0000","last_active":"2024-09-11T08:18:08.748125+0000","last_peered":"2024-09-11T08:18:08.748125+0000","last_clean":"2024-09-11T08:18:08.748125+0000","last_became_active":"2024-09-11T08:18:02.389296+0000","last_became_peered":"2024-09-11T08:18:02.389296+0000","last_unstale":"2024-09-11T08:18:08.748125+0000","last_undegraded":"2024-09-11T08:18:08.748125+0000","last_fullsized":"2024-09-11T08:18:08.748125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:48.847680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077017+0000","last_change":"2024-09-11T08:18:04.414431+0000","last_active":"2024-09-11T08:18:09.077017+0000","last_peered":"2024-09-11T08:18:09.077017+0000","last_clean":"2024-09-11T08:18:09.077017+0000","last_became_active":"2024-09-11T08:18:04.414136+0000","last_became_peered":"2024-09-11T08:18:04.414136+0000","last_unstale":"2024-09-11T08:18:09.077017+0000","last_undegraded":"2024-09-11T08:18:09.077017+0000","last_fullsized":"2024-09-11T08:18:09.077017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:26.899542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'13","reported_seq":43,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473376+0000","last_change":"2024-09-11T08:18:00.378438+0000","last_active":"2024-09-11T08:18:09.473376+0000","last_peered":"2024-09-11T08:18:09.473376+0000","last_clean":"2024-09-11T08:18:09.473376+0000","last_became_active":"2024-09-11T08:18:00.378200+0000","last_became_peered":"2024-09-11T08:18:00.378200+0000","last_unstale":"2024-09-11T08:18:09.473376+0000","last_undegraded":"2024-09-11T08:18:09.473376+0000","last_fullsized":"2024-09-11T08:18:09.473376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:21:12.222068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'5","reported_seq":111,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:29.018467+0000","last_change":"2024-09-11T08:18:02.384812+0000","last_active":"2024-09-11T08:19:29.018467+0000","last_peered":"2024-09-11T08:19:29.018467+0000","last_clean":"2024-09-11T08:19:29.018467+0000","last_became_active":"2024-09-11T08:17:58.362664+0000","last_became_peered":"2024-09-11T08:17:58.362664+0000","last_unstale":"2024-09-11T08:19:29.018467+0000","last_undegraded":"2024-09-11T08:19:29.018467+0000","last_fullsized":"2024-09-11T08:19:29.018467+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:45.805335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012178709999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471922+0000","last_change":"2024-09-11T08:17:58.360630+0000","last_active":"2024-09-11T08:18:09.471922+0000","last_peered":"2024-09-11T08:18:09.471922+0000","last_clean":"2024-09-11T08:18:09.471922+0000","last_became_active":"2024-09-11T08:17:58.360371+0000","last_became_peered":"2024-09-11T08:17:58.360371+0000","last_unstale":"2024-09-11T08:18:09.471922+0000","last_undegraded":"2024-09-11T08:18:09.471922+0000","last_fullsized":"2024-09-11T08:18:09.471922+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:34.286130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471872+0000","last_change":"2024-09-11T08:18:02.387913+0000","last_active":"2024-09-11T08:18:09.471872+0000","last_peered":"2024-09-11T08:18:09.471872+0000","last_clean":"2024-09-11T08:18:09.471872+0000","last_became_active":"2024-09-11T08:18:02.387594+0000","last_became_peered":"2024-09-11T08:18:02.387594+0000","last_unstale":"2024-09-11T08:18:09.471872+0000","last_undegraded":"2024-09-11T08:18:09.471872+0000","last_fullsized":"2024-09-11T08:18:09.471872+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:19:47.908684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472384+0000","last_change":"2024-09-11T08:18:04.444365+0000","last_active":"2024-09-11T08:18:09.472384+0000","last_peered":"2024-09-11T08:18:09.472384+0000","last_clean":"2024-09-11T08:18:09.472384+0000","last_became_active":"2024-09-11T08:18:04.443811+0000","last_became_peered":"2024-09-11T08:18:04.443811+0000","last_unstale":"2024-09-11T08:18:09.472384+0000","last_undegraded":"2024-09-11T08:18:09.472384+0000","last_fullsized":"2024-09-11T08:18:09.472384+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:02:50.285316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748420+0000","last_change":"2024-09-11T08:18:00.379468+0000","last_active":"2024-09-11T08:18:08.748420+0000","last_peered":"2024-09-11T08:18:08.748420+0000","last_clean":"2024-09-11T08:18:08.748420+0000","last_became_active":"2024-09-11T08:18:00.379159+0000","last_became_peered":"2024-09-11T08:18:00.379159+0000","last_unstale":"2024-09-11T08:18:08.748420+0000","last_undegraded":"2024-09-11T08:18:08.748420+0000","last_fullsized":"2024-09-11T08:18:08.748420+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:03.800446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"55'1","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747682+0000","last_change":"2024-09-11T08:18:02.383441+0000","last_active":"2024-09-11T08:18:08.747682+0000","last_peered":"2024-09-11T08:18:08.747682+0000","last_clean":"2024-09-11T08:18:08.747682+0000","last_became_active":"2024-09-11T08:17:58.363254+0000","last_became_peered":"2024-09-11T08:17:58.363254+0000","last_unstale":"2024-09-11T08:18:08.747682+0000","last_undegraded":"2024-09-11T08:18:08.747682+0000","last_fullsized":"2024-09-11T08:18:08.747682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:29:01.355163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044148400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471539+0000","last_change":"2024-09-11T08:17:58.366159+0000","last_active":"2024-09-11T08:18:09.471539+0000","last_peered":"2024-09-11T08:18:09.471539+0000","last_clean":"2024-09-11T08:18:09.471539+0000","last_became_active":"2024-09-11T08:17:58.365901+0000","last_became_peered":"2024-09-11T08:17:58.365901+0000","last_unstale":"2024-09-11T08:18:09.471539+0000","last_undegraded":"2024-09-11T08:18:09.471539+0000","last_fullsized":"2024-09-11T08:18:09.471539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:23.534962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472459+0000","last_change":"2024-09-11T08:18:02.394713+0000","last_active":"2024-09-11T08:18:09.472459+0000","last_peered":"2024-09-11T08:18:09.472459+0000","last_clean":"2024-09-11T08:18:09.472459+0000","last_became_active":"2024-09-11T08:18:02.394433+0000","last_became_peered":"2024-09-11T08:18:02.394433+0000","last_unstale":"2024-09-11T08:18:09.472459+0000","last_undegraded":"2024-09-11T08:18:09.472459+0000","last_fullsized":"2024-09-11T08:18:09.472459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:43.535958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472159+0000","last_change":"2024-09-11T08:18:04.415996+0000","last_active":"2024-09-11T08:18:09.472159+0000","last_peered":"2024-09-11T08:18:09.472159+0000","last_clean":"2024-09-11T08:18:09.472159+0000","last_became_active":"2024-09-11T08:18:04.415657+0000","last_became_peered":"2024-09-11T08:18:04.415657+0000","last_unstale":"2024-09-11T08:18:09.472159+0000","last_undegraded":"2024-09-11T08:18:09.472159+0000","last_fullsized":"2024-09-11T08:18:09.472159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:44:35.343736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'14","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382264+0000","last_change":"2024-09-11T08:18:00.520170+0000","last_active":"2024-09-11T08:18:09.382264+0000","last_peered":"2024-09-11T08:18:09.382264+0000","last_clean":"2024-09-11T08:18:09.382264+0000","last_became_active":"2024-09-11T08:18:00.519866+0000","last_became_peered":"2024-09-11T08:18:00.519866+0000","last_unstale":"2024-09-11T08:18:09.382264+0000","last_undegraded":"2024-09-11T08:18:09.382264+0000","last_fullsized":"2024-09-11T08:18:09.382264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:16:13.115745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"57'2","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076896+0000","last_change":"2024-09-11T08:18:02.388434+0000","last_active":"2024-09-11T08:18:09.076896+0000","last_peered":"2024-09-11T08:18:09.076896+0000","last_clean":"2024-09-11T08:18:09.076896+0000","last_became_active":"2024-09-11T08:17:58.364149+0000","last_became_peered":"2024-09-11T08:17:58.364149+0000","last_unstale":"2024-09-11T08:18:09.076896+0000","last_undegraded":"2024-09-11T08:18:09.076896+0000","last_fullsized":"2024-09-11T08:18:09.076896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:24.771375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030615939999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471751+0000","last_change":"2024-09-11T08:17:58.359370+0000","last_active":"2024-09-11T08:18:09.471751+0000","last_peered":"2024-09-11T08:18:09.471751+0000","last_clean":"2024-09-11T08:18:09.471751+0000","last_became_active":"2024-09-11T08:17:58.359081+0000","last_became_peered":"2024-09-11T08:17:58.359081+0000","last_unstale":"2024-09-11T08:18:09.471751+0000","last_undegraded":"2024-09-11T08:18:09.471751+0000","last_fullsized":"2024-09-11T08:18:09.471751+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:08.045976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"62'79","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:18:36.747224+0000","last_change":"2024-09-11T08:17:47.535403+0000","last_active":"2024-09-11T08:18:36.747224+0000","last_peered":"2024-09-11T08:18:36.747224+0000","last_clean":"2024-09-11T08:18:36.747224+0000","last_became_active":"2024-09-11T08:17:47.531270+0000","last_became_peered":"2024-09-11T08:17:47.531270+0000","last_unstale":"2024-09-11T08:18:36.747224+0000","last_undegraded":"2024-09-11T08:18:36.747224+0000","last_fullsized":"2024-09-11T08:18:36.747224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:15:48.959858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:15:48.959858+0000","last_clean_scrub_stamp":"2024-09-11T08:15:48.959858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:17.028056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472247+0000","last_change":"2024-09-11T08:18:02.389964+0000","last_active":"2024-09-11T08:18:09.472247+0000","last_peered":"2024-09-11T08:18:09.472247+0000","last_clean":"2024-09-11T08:18:09.472247+0000","last_became_active":"2024-09-11T08:18:02.389317+0000","last_became_peered":"2024-09-11T08:18:02.389317+0000","last_unstale":"2024-09-11T08:18:09.472247+0000","last_undegraded":"2024-09-11T08:18:09.472247+0000","last_fullsized":"2024-09-11T08:18:09.472247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472578+0000","last_change":"2024-09-11T08:18:04.415822+0000","last_active":"2024-09-11T08:18:09.472578+0000","last_peered":"2024-09-11T08:18:09.472578+0000","last_clean":"2024-09-11T08:18:09.472578+0000","last_became_active":"2024-09-11T08:18:04.415516+0000","last_became_peered":"2024-09-11T08:18:04.415516+0000","last_unstale":"2024-09-11T08:18:09.472578+0000","last_undegraded":"2024-09-11T08:18:09.472578+0000","last_fullsized":"2024-09-11T08:18:09.472578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:45:43.135489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"60'19","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382162+0000","last_change":"2024-09-11T08:18:00.520179+0000","last_active":"2024-09-11T08:18:09.382162+0000","last_peered":"2024-09-11T08:18:09.382162+0000","last_clean":"2024-09-11T08:18:09.382162+0000","last_became_active":"2024-09-11T08:18:00.519893+0000","last_became_peered":"2024-09-11T08:18:00.519893+0000","last_unstale":"2024-09-11T08:18:09.382162+0000","last_undegraded":"2024-09-11T08:18:09.382162+0000","last_fullsized":"2024-09-11T08:18:09.382162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:45.145939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472682+0000","last_change":"2024-09-11T08:17:58.356997+0000","last_active":"2024-09-11T08:18:09.472682+0000","last_peered":"2024-09-11T08:18:09.472682+0000","last_clean":"2024-09-11T08:18:09.472682+0000","last_became_active":"2024-09-11T08:17:58.356738+0000","last_became_peered":"2024-09-11T08:17:58.356738+0000","last_unstale":"2024-09-11T08:18:09.472682+0000","last_undegraded":"2024-09-11T08:18:09.472682+0000","last_fullsized":"2024-09-11T08:18:09.472682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:32.279057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472388+0000","last_change":"2024-09-11T08:18:02.389777+0000","last_active":"2024-09-11T08:18:09.472388+0000","last_peered":"2024-09-11T08:18:09.472388+0000","last_clean":"2024-09-11T08:18:09.472388+0000","last_became_active":"2024-09-11T08:18:02.389477+0000","last_became_peered":"2024-09-11T08:18:02.389477+0000","last_unstale":"2024-09-11T08:18:09.472388+0000","last_undegraded":"2024-09-11T08:18:09.472388+0000","last_fullsized":"2024-09-11T08:18:09.472388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:28.929835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471590+0000","last_change":"2024-09-11T08:18:04.415248+0000","last_active":"2024-09-11T08:18:09.471590+0000","last_peered":"2024-09-11T08:18:09.471590+0000","last_clean":"2024-09-11T08:18:09.471590+0000","last_became_active":"2024-09-11T08:18:04.414978+0000","last_became_peered":"2024-09-11T08:18:04.414978+0000","last_unstale":"2024-09-11T08:18:09.471590+0000","last_undegraded":"2024-09-11T08:18:09.471590+0000","last_fullsized":"2024-09-11T08:18:09.471590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:51.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747886+0000","last_change":"2024-09-11T08:18:00.377316+0000","last_active":"2024-09-11T08:18:08.747886+0000","last_peered":"2024-09-11T08:18:08.747886+0000","last_clean":"2024-09-11T08:18:08.747886+0000","last_became_active":"2024-09-11T08:18:00.376878+0000","last_became_peered":"2024-09-11T08:18:00.376878+0000","last_unstale":"2024-09-11T08:18:08.747886+0000","last_undegraded":"2024-09-11T08:18:08.747886+0000","last_fullsized":"2024-09-11T08:18:08.747886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:56.565389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473285+0000","last_change":"2024-09-11T08:17:58.362161+0000","last_active":"2024-09-11T08:18:09.473285+0000","last_peered":"2024-09-11T08:18:09.473285+0000","last_clean":"2024-09-11T08:18:09.473285+0000","last_became_active":"2024-09-11T08:17:58.361891+0000","last_became_peered":"2024-09-11T08:17:58.361891+0000","last_unstale":"2024-09-11T08:18:09.473285+0000","last_undegraded":"2024-09-11T08:18:09.473285+0000","last_fullsized":"2024-09-11T08:18:09.473285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:18.239643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471739+0000","last_change":"2024-09-11T08:18:02.394641+0000","last_active":"2024-09-11T08:18:09.471739+0000","last_peered":"2024-09-11T08:18:09.471739+0000","last_clean":"2024-09-11T08:18:09.471739+0000","last_became_active":"2024-09-11T08:18:02.394345+0000","last_became_peered":"2024-09-11T08:18:02.394345+0000","last_unstale":"2024-09-11T08:18:09.471739+0000","last_undegraded":"2024-09-11T08:18:09.471739+0000","last_fullsized":"2024-09-11T08:18:09.471739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:51.377855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747564+0000","last_change":"2024-09-11T08:18:04.413429+0000","last_active":"2024-09-11T08:18:08.747564+0000","last_peered":"2024-09-11T08:18:08.747564+0000","last_clean":"2024-09-11T08:18:08.747564+0000","last_became_active":"2024-09-11T08:18:04.413115+0000","last_became_peered":"2024-09-11T08:18:04.413115+0000","last_unstale":"2024-09-11T08:18:08.747564+0000","last_undegraded":"2024-09-11T08:18:08.747564+0000","last_fullsized":"2024-09-11T08:18:08.747564+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:44.902232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471209+0000","last_change":"2024-09-11T08:18:00.520459+0000","last_active":"2024-09-11T08:18:09.471209+0000","last_peered":"2024-09-11T08:18:09.471209+0000","last_clean":"2024-09-11T08:18:09.471209+0000","last_became_active":"2024-09-11T08:18:00.520032+0000","last_became_peered":"2024-09-11T08:18:00.520032+0000","last_unstale":"2024-09-11T08:18:09.471209+0000","last_undegraded":"2024-09-11T08:18:09.471209+0000","last_fullsized":"2024-09-11T08:18:09.471209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:11.421002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472160+0000","last_change":"2024-09-11T08:17:58.366165+0000","last_active":"2024-09-11T08:18:09.472160+0000","last_peered":"2024-09-11T08:18:09.472160+0000","last_clean":"2024-09-11T08:18:09.472160+0000","last_became_active":"2024-09-11T08:17:58.365850+0000","last_became_peered":"2024-09-11T08:17:58.365850+0000","last_unstale":"2024-09-11T08:18:09.472160+0000","last_undegraded":"2024-09-11T08:18:09.472160+0000","last_fullsized":"2024-09-11T08:18:09.472160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:50:55.659159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460590+0000","last_change":"2024-09-11T08:18:02.390319+0000","last_active":"2024-09-11T08:19:21.460590+0000","last_peered":"2024-09-11T08:19:21.460590+0000","last_clean":"2024-09-11T08:19:21.460590+0000","last_became_active":"2024-09-11T08:18:02.389556+0000","last_became_peered":"2024-09-11T08:18:02.389556+0000","last_unstale":"2024-09-11T08:19:21.460590+0000","last_undegraded":"2024-09-11T08:19:21.460590+0000","last_fullsized":"2024-09-11T08:19:21.460590+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:29:48.969198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471376+0000","last_change":"2024-09-11T08:18:04.444996+0000","last_active":"2024-09-11T08:18:09.471376+0000","last_peered":"2024-09-11T08:18:09.471376+0000","last_clean":"2024-09-11T08:18:09.471376+0000","last_became_active":"2024-09-11T08:18:04.444709+0000","last_became_peered":"2024-09-11T08:18:04.444709+0000","last_unstale":"2024-09-11T08:18:09.471376+0000","last_undegraded":"2024-09-11T08:18:09.471376+0000","last_fullsized":"2024-09-11T08:18:09.471376+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:39.444151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"60'12","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743323+0000","last_change":"2024-09-11T08:18:00.384021+0000","last_active":"2024-09-11T08:18:08.743323+0000","last_peered":"2024-09-11T08:18:08.743323+0000","last_clean":"2024-09-11T08:18:08.743323+0000","last_became_active":"2024-09-11T08:18:00.383792+0000","last_became_peered":"2024-09-11T08:18:00.383792+0000","last_unstale":"2024-09-11T08:18:08.743323+0000","last_undegraded":"2024-09-11T08:18:08.743323+0000","last_fullsized":"2024-09-11T08:18:08.743323+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:14:57.106894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"53'2","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.744073+0000","last_change":"2024-09-11T08:17:58.357964+0000","last_active":"2024-09-11T08:18:08.744073+0000","last_peered":"2024-09-11T08:18:08.744073+0000","last_clean":"2024-09-11T08:18:08.744073+0000","last_became_active":"2024-09-11T08:17:58.357693+0000","last_became_peered":"2024-09-11T08:17:58.357693+0000","last_unstale":"2024-09-11T08:18:08.744073+0000","last_undegraded":"2024-09-11T08:18:08.744073+0000","last_fullsized":"2024-09-11T08:18:08.744073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:32.360350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471695+0000","last_change":"2024-09-11T08:18:02.386200+0000","last_active":"2024-09-11T08:18:09.471695+0000","last_peered":"2024-09-11T08:18:09.471695+0000","last_clean":"2024-09-11T08:18:09.471695+0000","last_became_active":"2024-09-11T08:18:02.385798+0000","last_became_peered":"2024-09-11T08:18:02.385798+0000","last_unstale":"2024-09-11T08:18:09.471695+0000","last_undegraded":"2024-09-11T08:18:09.471695+0000","last_fullsized":"2024-09-11T08:18:09.471695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:59:40.578736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076639+0000","last_change":"2024-09-11T08:18:04.413455+0000","last_active":"2024-09-11T08:18:09.076639+0000","last_peered":"2024-09-11T08:18:09.076639+0000","last_clean":"2024-09-11T08:18:09.076639+0000","last_became_active":"2024-09-11T08:18:04.413188+0000","last_became_peered":"2024-09-11T08:18:04.413188+0000","last_unstale":"2024-09-11T08:18:09.076639+0000","last_undegraded":"2024-09-11T08:18:09.076639+0000","last_fullsized":"2024-09-11T08:18:09.076639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:24.468317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748345+0000","last_change":"2024-09-11T08:18:00.520384+0000","last_active":"2024-09-11T08:18:08.748345+0000","last_peered":"2024-09-11T08:18:08.748345+0000","last_clean":"2024-09-11T08:18:08.748345+0000","last_became_active":"2024-09-11T08:18:00.520126+0000","last_became_peered":"2024-09-11T08:18:00.520126+0000","last_unstale":"2024-09-11T08:18:08.748345+0000","last_undegraded":"2024-09-11T08:18:08.748345+0000","last_fullsized":"2024-09-11T08:18:08.748345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:46.312895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472476+0000","last_change":"2024-09-11T08:17:58.358077+0000","last_active":"2024-09-11T08:18:09.472476+0000","last_peered":"2024-09-11T08:18:09.472476+0000","last_clean":"2024-09-11T08:18:09.472476+0000","last_became_active":"2024-09-11T08:17:58.357813+0000","last_became_peered":"2024-09-11T08:17:58.357813+0000","last_unstale":"2024-09-11T08:18:09.472476+0000","last_undegraded":"2024-09-11T08:18:09.472476+0000","last_fullsized":"2024-09-11T08:18:09.472476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:07.895452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077203+0000","last_change":"2024-09-11T08:18:02.393530+0000","last_active":"2024-09-11T08:18:09.077203+0000","last_peered":"2024-09-11T08:18:09.077203+0000","last_clean":"2024-09-11T08:18:09.077203+0000","last_became_active":"2024-09-11T08:18:02.393208+0000","last_became_peered":"2024-09-11T08:18:02.393208+0000","last_unstale":"2024-09-11T08:18:09.077203+0000","last_undegraded":"2024-09-11T08:18:09.077203+0000","last_fullsized":"2024-09-11T08:18:09.077203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:29.190564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472197+0000","last_change":"2024-09-11T08:18:04.407441+0000","last_active":"2024-09-11T08:18:09.472197+0000","last_peered":"2024-09-11T08:18:09.472197+0000","last_clean":"2024-09-11T08:18:09.472197+0000","last_became_active":"2024-09-11T08:18:04.407168+0000","last_became_peered":"2024-09-11T08:18:04.407168+0000","last_unstale":"2024-09-11T08:18:09.472197+0000","last_undegraded":"2024-09-11T08:18:09.472197+0000","last_fullsized":"2024-09-11T08:18:09.472197+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:11.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382027+0000","last_change":"2024-09-11T08:17:58.361771+0000","last_active":"2024-09-11T08:18:09.382027+0000","last_peered":"2024-09-11T08:18:09.382027+0000","last_clean":"2024-09-11T08:18:09.382027+0000","last_became_active":"2024-09-11T08:17:58.359272+0000","last_became_peered":"2024-09-11T08:17:58.359272+0000","last_unstale":"2024-09-11T08:18:09.382027+0000","last_undegraded":"2024-09-11T08:18:09.382027+0000","last_fullsized":"2024-09-11T08:18:09.382027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:44:55.513104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'6","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077295+0000","last_change":"2024-09-11T08:18:00.520055+0000","last_active":"2024-09-11T08:18:09.077295+0000","last_peered":"2024-09-11T08:18:09.077295+0000","last_clean":"2024-09-11T08:18:09.077295+0000","last_became_active":"2024-09-11T08:18:00.519688+0000","last_became_peered":"2024-09-11T08:18:00.519688+0000","last_unstale":"2024-09-11T08:18:09.077295+0000","last_undegraded":"2024-09-11T08:18:09.077295+0000","last_fullsized":"2024-09-11T08:18:09.077295+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:35.352061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472188+0000","last_change":"2024-09-11T08:18:02.393997+0000","last_active":"2024-09-11T08:18:09.472188+0000","last_peered":"2024-09-11T08:18:09.472188+0000","last_clean":"2024-09-11T08:18:09.472188+0000","last_became_active":"2024-09-11T08:18:02.393716+0000","last_became_peered":"2024-09-11T08:18:02.393716+0000","last_unstale":"2024-09-11T08:18:09.472188+0000","last_undegraded":"2024-09-11T08:18:09.472188+0000","last_fullsized":"2024-09-11T08:18:09.472188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:34.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472306+0000","last_change":"2024-09-11T08:18:04.444236+0000","last_active":"2024-09-11T08:18:09.472306+0000","last_peered":"2024-09-11T08:18:09.472306+0000","last_clean":"2024-09-11T08:18:09.472306+0000","last_became_active":"2024-09-11T08:18:04.443908+0000","last_became_peered":"2024-09-11T08:18:04.443908+0000","last_unstale":"2024-09-11T08:18:09.472306+0000","last_undegraded":"2024-09-11T08:18:09.472306+0000","last_fullsized":"2024-09-11T08:18:09.472306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:58.588867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077320+0000","last_change":"2024-09-11T08:18:00.520252+0000","last_active":"2024-09-11T08:18:09.077320+0000","last_peered":"2024-09-11T08:18:09.077320+0000","last_clean":"2024-09-11T08:18:09.077320+0000","last_became_active":"2024-09-11T08:18:00.519974+0000","last_became_peered":"2024-09-11T08:18:00.519974+0000","last_unstale":"2024-09-11T08:18:09.077320+0000","last_undegraded":"2024-09-11T08:18:09.077320+0000","last_fullsized":"2024-09-11T08:18:09.077320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:27.962920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472667+0000","last_change":"2024-09-11T08:17:58.361893+0000","last_active":"2024-09-11T08:18:09.472667+0000","last_peered":"2024-09-11T08:18:09.472667+0000","last_clean":"2024-09-11T08:18:09.472667+0000","last_became_active":"2024-09-11T08:17:58.361639+0000","last_became_peered":"2024-09-11T08:17:58.361639+0000","last_unstale":"2024-09-11T08:18:09.472667+0000","last_undegraded":"2024-09-11T08:18:09.472667+0000","last_fullsized":"2024-09-11T08:18:09.472667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:26.091382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":43,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460585+0000","last_change":"2024-09-11T08:18:02.395869+0000","last_active":"2024-09-11T08:19:21.460585+0000","last_peered":"2024-09-11T08:19:21.460585+0000","last_clean":"2024-09-11T08:19:21.460585+0000","last_became_active":"2024-09-11T08:18:02.394374+0000","last_became_peered":"2024-09-11T08:18:02.394374+0000","last_unstale":"2024-09-11T08:19:21.460585+0000","last_undegraded":"2024-09-11T08:19:21.460585+0000","last_fullsized":"2024-09-11T08:19:21.460585+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:42.701032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748215+0000","last_change":"2024-09-11T08:18:04.415663+0000","last_active":"2024-09-11T08:18:08.748215+0000","last_peered":"2024-09-11T08:18:08.748215+0000","last_clean":"2024-09-11T08:18:08.748215+0000","last_became_active":"2024-09-11T08:18:04.415380+0000","last_became_peered":"2024-09-11T08:18:04.415380+0000","last_unstale":"2024-09-11T08:18:08.748215+0000","last_undegraded":"2024-09-11T08:18:08.748215+0000","last_fullsized":"2024-09-11T08:18:08.748215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472237+0000","last_change":"2024-09-11T08:18:00.520790+0000","last_active":"2024-09-11T08:18:09.472237+0000","last_peered":"2024-09-11T08:18:09.472237+0000","last_clean":"2024-09-11T08:18:09.472237+0000","last_became_active":"2024-09-11T08:18:00.520020+0000","last_became_peered":"2024-09-11T08:18:00.520020+0000","last_unstale":"2024-09-11T08:18:09.472237+0000","last_undegraded":"2024-09-11T08:18:09.472237+0000","last_fullsized":"2024-09-11T08:18:09.472237+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:12:04.632464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748072+0000","last_change":"2024-09-11T08:17:58.362039+0000","last_active":"2024-09-11T08:18:08.748072+0000","last_peered":"2024-09-11T08:18:08.748072+0000","last_clean":"2024-09-11T08:18:08.748072+0000","last_became_active":"2024-09-11T08:17:58.361763+0000","last_became_peered":"2024-09-11T08:17:58.361763+0000","last_unstale":"2024-09-11T08:18:08.748072+0000","last_undegraded":"2024-09-11T08:18:08.748072+0000","last_fullsized":"2024-09-11T08:18:08.748072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:54.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":40,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460511+0000","last_change":"2024-09-11T08:18:02.397916+0000","last_active":"2024-09-11T08:19:21.460511+0000","last_peered":"2024-09-11T08:19:21.460511+0000","last_clean":"2024-09-11T08:19:21.460511+0000","last_became_active":"2024-09-11T08:18:02.397534+0000","last_became_peered":"2024-09-11T08:18:02.397534+0000","last_unstale":"2024-09-11T08:19:21.460511+0000","last_undegraded":"2024-09-11T08:19:21.460511+0000","last_fullsized":"2024-09-11T08:19:21.460511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:35.783024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743968+0000","last_change":"2024-09-11T08:18:04.405974+0000","last_active":"2024-09-11T08:18:08.743968+0000","last_peered":"2024-09-11T08:18:08.743968+0000","last_clean":"2024-09-11T08:18:08.743968+0000","last_became_active":"2024-09-11T08:18:04.405707+0000","last_became_peered":"2024-09-11T08:18:04.405707+0000","last_unstale":"2024-09-11T08:18:08.743968+0000","last_undegraded":"2024-09-11T08:18:08.743968+0000","last_fullsized":"2024-09-11T08:18:08.743968+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:02.611151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472706+0000","last_change":"2024-09-11T08:18:00.379512+0000","last_active":"2024-09-11T08:18:09.472706+0000","last_peered":"2024-09-11T08:18:09.472706+0000","last_clean":"2024-09-11T08:18:09.472706+0000","last_became_active":"2024-09-11T08:18:00.379223+0000","last_became_peered":"2024-09-11T08:18:00.379223+0000","last_unstale":"2024-09-11T08:18:09.472706+0000","last_undegraded":"2024-09-11T08:18:09.472706+0000","last_fullsized":"2024-09-11T08:18:09.472706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:47:42.679988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382175+0000","last_change":"2024-09-11T08:17:58.362209+0000","last_active":"2024-09-11T08:18:09.382175+0000","last_peered":"2024-09-11T08:18:09.382175+0000","last_clean":"2024-09-11T08:18:09.382175+0000","last_became_active":"2024-09-11T08:17:58.361902+0000","last_became_peered":"2024-09-11T08:17:58.361902+0000","last_unstale":"2024-09-11T08:18:09.382175+0000","last_undegraded":"2024-09-11T08:18:09.382175+0000","last_fullsized":"2024-09-11T08:18:09.382175+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:01.286395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076678+0000","last_change":"2024-09-11T08:18:02.393465+0000","last_active":"2024-09-11T08:18:09.076678+0000","last_peered":"2024-09-11T08:18:09.076678+0000","last_clean":"2024-09-11T08:18:09.076678+0000","last_became_active":"2024-09-11T08:18:02.393170+0000","last_became_peered":"2024-09-11T08:18:02.393170+0000","last_unstale":"2024-09-11T08:18:09.076678+0000","last_undegraded":"2024-09-11T08:18:09.076678+0000","last_fullsized":"2024-09-11T08:18:09.076678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:55:26.563148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.747304+0000","last_change":"2024-09-11T08:18:04.414431+0000","last_active":"2024-09-11T08:18:08.747304+0000","last_peered":"2024-09-11T08:18:08.747304+0000","last_clean":"2024-09-11T08:18:08.747304+0000","last_became_active":"2024-09-11T08:18:04.413988+0000","last_became_peered":"2024-09-11T08:18:04.413988+0000","last_unstale":"2024-09-11T08:18:08.747304+0000","last_undegraded":"2024-09-11T08:18:08.747304+0000","last_fullsized":"2024-09-11T08:18:08.747304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:31.866938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743546+0000","last_change":"2024-09-11T08:18:00.379696+0000","last_active":"2024-09-11T08:18:08.743546+0000","last_peered":"2024-09-11T08:18:08.743546+0000","last_clean":"2024-09-11T08:18:08.743546+0000","last_became_active":"2024-09-11T08:18:00.379020+0000","last_became_peered":"2024-09-11T08:18:00.379020+0000","last_unstale":"2024-09-11T08:18:08.743546+0000","last_undegraded":"2024-09-11T08:18:08.743546+0000","last_fullsized":"2024-09-11T08:18:08.743546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:56.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473214+0000","last_change":"2024-09-11T08:17:58.357853+0000","last_active":"2024-09-11T08:18:09.473214+0000","last_peered":"2024-09-11T08:18:09.473214+0000","last_clean":"2024-09-11T08:18:09.473214+0000","last_became_active":"2024-09-11T08:17:58.357576+0000","last_became_peered":"2024-09-11T08:17:58.357576+0000","last_unstale":"2024-09-11T08:18:09.473214+0000","last_undegraded":"2024-09-11T08:18:09.473214+0000","last_fullsized":"2024-09-11T08:18:09.473214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:19:31.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472518+0000","last_change":"2024-09-11T08:18:02.393837+0000","last_active":"2024-09-11T08:18:09.472518+0000","last_peered":"2024-09-11T08:18:09.472518+0000","last_clean":"2024-09-11T08:18:09.472518+0000","last_became_active":"2024-09-11T08:18:02.393513+0000","last_became_peered":"2024-09-11T08:18:02.393513+0000","last_unstale":"2024-09-11T08:18:09.472518+0000","last_undegraded":"2024-09-11T08:18:09.472518+0000","last_fullsized":"2024-09-11T08:18:09.472518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076417+0000","last_change":"2024-09-11T08:18:04.415005+0000","last_active":"2024-09-11T08:18:09.076417+0000","last_peered":"2024-09-11T08:18:09.076417+0000","last_clean":"2024-09-11T08:18:09.076417+0000","last_became_active":"2024-09-11T08:18:04.414714+0000","last_became_peered":"2024-09-11T08:18:04.414714+0000","last_unstale":"2024-09-11T08:18:09.076417+0000","last_undegraded":"2024-09-11T08:18:09.076417+0000","last_fullsized":"2024-09-11T08:18:09.076417+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:15.184562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076408+0000","last_change":"2024-09-11T08:18:00.385501+0000","last_active":"2024-09-11T08:18:09.076408+0000","last_peered":"2024-09-11T08:18:09.076408+0000","last_clean":"2024-09-11T08:18:09.076408+0000","last_became_active":"2024-09-11T08:18:00.385206+0000","last_became_peered":"2024-09-11T08:18:00.385206+0000","last_unstale":"2024-09-11T08:18:09.076408+0000","last_undegraded":"2024-09-11T08:18:09.076408+0000","last_fullsized":"2024-09-11T08:18:09.076408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:11.792134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472308+0000","last_change":"2024-09-11T08:17:58.363585+0000","last_active":"2024-09-11T08:18:09.472308+0000","last_peered":"2024-09-11T08:18:09.472308+0000","last_clean":"2024-09-11T08:18:09.472308+0000","last_became_active":"2024-09-11T08:17:58.360310+0000","last_became_peered":"2024-09-11T08:17:58.360310+0000","last_unstale":"2024-09-11T08:18:09.472308+0000","last_undegraded":"2024-09-11T08:18:09.472308+0000","last_fullsized":"2024-09-11T08:18:09.472308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:01.264216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.381884+0000","last_change":"2024-09-11T08:18:02.393310+0000","last_active":"2024-09-11T08:18:09.381884+0000","last_peered":"2024-09-11T08:18:09.381884+0000","last_clean":"2024-09-11T08:18:09.381884+0000","last_became_active":"2024-09-11T08:18:02.391772+0000","last_became_peered":"2024-09-11T08:18:02.391772+0000","last_unstale":"2024-09-11T08:18:09.381884+0000","last_undegraded":"2024-09-11T08:18:09.381884+0000","last_fullsized":"2024-09-11T08:18:09.381884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:53.699344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471508+0000","last_change":"2024-09-11T08:18:04.409389+0000","last_active":"2024-09-11T08:18:09.471508+0000","last_peered":"2024-09-11T08:18:09.471508+0000","last_clean":"2024-09-11T08:18:09.471508+0000","last_became_active":"2024-09-11T08:18:04.409047+0000","last_became_peered":"2024-09-11T08:18:04.409047+0000","last_unstale":"2024-09-11T08:18:09.471508+0000","last_undegraded":"2024-09-11T08:18:09.471508+0000","last_fullsized":"2024-09-11T08:18:09.471508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:57.143676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076522+0000","last_change":"2024-09-11T08:18:00.520032+0000","last_active":"2024-09-11T08:18:09.076522+0000","last_peered":"2024-09-11T08:18:09.076522+0000","last_clean":"2024-09-11T08:18:09.076522+0000","last_became_active":"2024-09-11T08:18:00.519760+0000","last_became_peered":"2024-09-11T08:18:00.519760+0000","last_unstale":"2024-09-11T08:18:09.076522+0000","last_undegraded":"2024-09-11T08:18:09.076522+0000","last_fullsized":"2024-09-11T08:18:09.076522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:31.996641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382407+0000","last_change":"2024-09-11T08:17:58.357614+0000","last_active":"2024-09-11T08:18:09.382407+0000","last_peered":"2024-09-11T08:18:09.382407+0000","last_clean":"2024-09-11T08:18:09.382407+0000","last_became_active":"2024-09-11T08:17:58.357337+0000","last_became_peered":"2024-09-11T08:17:58.357337+0000","last_unstale":"2024-09-11T08:18:09.382407+0000","last_undegraded":"2024-09-11T08:18:09.382407+0000","last_fullsized":"2024-09-11T08:18:09.382407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:04.284963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471270+0000","last_change":"2024-09-11T08:18:02.392015+0000","last_active":"2024-09-11T08:18:09.471270+0000","last_peered":"2024-09-11T08:18:09.471270+0000","last_clean":"2024-09-11T08:18:09.471270+0000","last_became_active":"2024-09-11T08:18:02.390703+0000","last_became_peered":"2024-09-11T08:18:02.390703+0000","last_unstale":"2024-09-11T08:18:09.471270+0000","last_undegraded":"2024-09-11T08:18:09.471270+0000","last_fullsized":"2024-09-11T08:18:09.471270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:01.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076563+0000","last_change":"2024-09-11T08:18:04.443943+0000","last_active":"2024-09-11T08:18:09.076563+0000","last_peered":"2024-09-11T08:18:09.076563+0000","last_clean":"2024-09-11T08:18:09.076563+0000","last_became_active":"2024-09-11T08:18:04.443660+0000","last_became_peered":"2024-09-11T08:18:04.443660+0000","last_unstale":"2024-09-11T08:18:09.076563+0000","last_undegraded":"2024-09-11T08:18:09.076563+0000","last_fullsized":"2024-09-11T08:18:09.076563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.746864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472228+0000","last_change":"2024-09-11T08:18:04.410052+0000","last_active":"2024-09-11T08:18:09.472228+0000","last_peered":"2024-09-11T08:18:09.472228+0000","last_clean":"2024-09-11T08:18:09.472228+0000","last_became_active":"2024-09-11T08:18:04.409768+0000","last_became_peered":"2024-09-11T08:18:04.409768+0000","last_unstale":"2024-09-11T08:18:09.472228+0000","last_undegraded":"2024-09-11T08:18:09.472228+0000","last_fullsized":"2024-09-11T08:18:09.472228+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:50:33.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.471233+0000","last_change":"2024-09-11T08:17:58.361806+0000","last_active":"2024-09-11T08:18:09.471233+0000","last_peered":"2024-09-11T08:18:09.471233+0000","last_clean":"2024-09-11T08:18:09.471233+0000","last_became_active":"2024-09-11T08:17:58.361523+0000","last_became_peered":"2024-09-11T08:17:58.361523+0000","last_unstale":"2024-09-11T08:18:09.471233+0000","last_undegraded":"2024-09-11T08:18:09.471233+0000","last_fullsized":"2024-09-11T08:18:09.471233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:58:08.207346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'10","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748339+0000","last_change":"2024-09-11T08:18:00.521128+0000","last_active":"2024-09-11T08:18:08.748339+0000","last_peered":"2024-09-11T08:18:08.748339+0000","last_clean":"2024-09-11T08:18:08.748339+0000","last_became_active":"2024-09-11T08:18:00.520872+0000","last_became_peered":"2024-09-11T08:18:00.520872+0000","last_unstale":"2024-09-11T08:18:08.748339+0000","last_undegraded":"2024-09-11T08:18:08.748339+0000","last_fullsized":"2024-09-11T08:18:08.748339+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:55:48.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":43,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T08:19:21.460573+0000","last_change":"2024-09-11T08:18:02.393162+0000","last_active":"2024-09-11T08:19:21.460573+0000","last_peered":"2024-09-11T08:19:21.460573+0000","last_clean":"2024-09-11T08:19:21.460573+0000","last_became_active":"2024-09-11T08:18:02.390577+0000","last_became_peered":"2024-09-11T08:18:02.390577+0000","last_unstale":"2024-09-11T08:19:21.460573+0000","last_undegraded":"2024-09-11T08:19:21.460573+0000","last_fullsized":"2024-09-11T08:19:21.460573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:40.325762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472368+0000","last_change":"2024-09-11T08:18:04.410713+0000","last_active":"2024-09-11T08:18:09.472368+0000","last_peered":"2024-09-11T08:18:09.472368+0000","last_clean":"2024-09-11T08:18:09.472368+0000","last_became_active":"2024-09-11T08:18:04.410369+0000","last_became_peered":"2024-09-11T08:18:04.410369+0000","last_unstale":"2024-09-11T08:18:09.472368+0000","last_undegraded":"2024-09-11T08:18:09.472368+0000","last_fullsized":"2024-09-11T08:18:09.472368+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:03.047857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.076804+0000","last_change":"2024-09-11T08:17:58.362638+0000","last_active":"2024-09-11T08:18:09.076804+0000","last_peered":"2024-09-11T08:18:09.076804+0000","last_clean":"2024-09-11T08:18:09.076804+0000","last_became_active":"2024-09-11T08:17:58.362371+0000","last_became_peered":"2024-09-11T08:17:58.362371+0000","last_unstale":"2024-09-11T08:18:09.076804+0000","last_undegraded":"2024-09-11T08:18:09.076804+0000","last_fullsized":"2024-09-11T08:18:09.076804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:05:22.393730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'11","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382390+0000","last_change":"2024-09-11T08:18:00.377240+0000","last_active":"2024-09-11T08:18:09.382390+0000","last_peered":"2024-09-11T08:18:09.382390+0000","last_clean":"2024-09-11T08:18:09.382390+0000","last_became_active":"2024-09-11T08:18:00.376909+0000","last_became_peered":"2024-09-11T08:18:00.376909+0000","last_unstale":"2024-09-11T08:18:09.382390+0000","last_undegraded":"2024-09-11T08:18:09.382390+0000","last_fullsized":"2024-09-11T08:18:09.382390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:08.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.748286+0000","last_change":"2024-09-11T08:18:02.391686+0000","last_active":"2024-09-11T08:18:08.748286+0000","last_peered":"2024-09-11T08:18:08.748286+0000","last_clean":"2024-09-11T08:18:08.748286+0000","last_became_active":"2024-09-11T08:18:02.391385+0000","last_became_peered":"2024-09-11T08:18:02.391385+0000","last_unstale":"2024-09-11T08:18:08.748286+0000","last_undegraded":"2024-09-11T08:18:08.748286+0000","last_fullsized":"2024-09-11T08:18:08.748286+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:11.689121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743873+0000","last_change":"2024-09-11T08:18:04.443059+0000","last_active":"2024-09-11T08:18:08.743873+0000","last_peered":"2024-09-11T08:18:08.743873+0000","last_clean":"2024-09-11T08:18:08.743873+0000","last_became_active":"2024-09-11T08:18:04.442687+0000","last_became_peered":"2024-09-11T08:18:04.442687+0000","last_unstale":"2024-09-11T08:18:08.743873+0000","last_undegraded":"2024-09-11T08:18:08.743873+0000","last_fullsized":"2024-09-11T08:18:08.743873+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:24:31.764095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"53'1","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.382260+0000","last_change":"2024-09-11T08:17:58.363183+0000","last_active":"2024-09-11T08:18:09.382260+0000","last_peered":"2024-09-11T08:18:09.382260+0000","last_clean":"2024-09-11T08:18:09.382260+0000","last_became_active":"2024-09-11T08:17:58.362916+0000","last_became_peered":"2024-09-11T08:17:58.362916+0000","last_unstale":"2024-09-11T08:18:09.382260+0000","last_undegraded":"2024-09-11T08:18:09.382260+0000","last_fullsized":"2024-09-11T08:18:09.382260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:26:54.479483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.472468+0000","last_change":"2024-09-11T08:18:00.382812+0000","last_active":"2024-09-11T08:18:09.472468+0000","last_peered":"2024-09-11T08:18:09.472468+0000","last_clean":"2024-09-11T08:18:09.472468+0000","last_became_active":"2024-09-11T08:18:00.382533+0000","last_became_peered":"2024-09-11T08:18:00.382533+0000","last_unstale":"2024-09-11T08:18:09.472468+0000","last_undegraded":"2024-09-11T08:18:09.472468+0000","last_fullsized":"2024-09-11T08:18:09.472468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:27.840035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.473043+0000","last_change":"2024-09-11T08:18:02.393411+0000","last_active":"2024-09-11T08:18:09.473043+0000","last_peered":"2024-09-11T08:18:09.473043+0000","last_clean":"2024-09-11T08:18:09.473043+0000","last_became_active":"2024-09-11T08:18:02.393026+0000","last_became_peered":"2024-09-11T08:18:02.393026+0000","last_unstale":"2024-09-11T08:18:09.473043+0000","last_undegraded":"2024-09-11T08:18:09.473043+0000","last_fullsized":"2024-09-11T08:18:09.473043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:55:44.238671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077130+0000","last_change":"2024-09-11T08:18:04.443724+0000","last_active":"2024-09-11T08:18:09.077130+0000","last_peered":"2024-09-11T08:18:09.077130+0000","last_clean":"2024-09-11T08:18:09.077130+0000","last_became_active":"2024-09-11T08:18:04.443379+0000","last_became_peered":"2024-09-11T08:18:04.443379+0000","last_unstale":"2024-09-11T08:18:09.077130+0000","last_undegraded":"2024-09-11T08:18:09.077130+0000","last_fullsized":"2024-09-11T08:18:09.077130+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:03.376193+0000","last_clean_scrub_stamp":"2024-09-11T08:18:03.376193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:09:42.355636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077172+0000","last_change":"2024-09-11T08:17:58.365234+0000","last_active":"2024-09-11T08:18:09.077172+0000","last_peered":"2024-09-11T08:18:09.077172+0000","last_clean":"2024-09-11T08:18:09.077172+0000","last_became_active":"2024-09-11T08:17:58.364962+0000","last_became_peered":"2024-09-11T08:17:58.364962+0000","last_unstale":"2024-09-11T08:18:09.077172+0000","last_undegraded":"2024-09-11T08:18:09.077172+0000","last_fullsized":"2024-09-11T08:18:09.077172+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:57.331595+0000","last_clean_scrub_stamp":"2024-09-11T08:17:57.331595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:57.179380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'12","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:09.077156+0000","last_change":"2024-09-11T08:18:00.384460+0000","last_active":"2024-09-11T08:18:09.077156+0000","last_peered":"2024-09-11T08:18:09.077156+0000","last_clean":"2024-09-11T08:18:09.077156+0000","last_became_active":"2024-09-11T08:18:00.384165+0000","last_became_peered":"2024-09-11T08:18:00.384165+0000","last_unstale":"2024-09-11T08:18:09.077156+0000","last_undegraded":"2024-09-11T08:18:09.077156+0000","last_fullsized":"2024-09-11T08:18:09.077156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:17:59.348189+0000","last_clean_scrub_stamp":"2024-09-11T08:17:59.348189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:55.602639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T08:18:08.743622+0000","last_change":"2024-09-11T08:18:02.397134+0000","last_active":"2024-09-11T08:18:08.743622+0000","last_peered":"2024-09-11T08:18:08.743622+0000","last_clean":"2024-09-11T08:18:08.743622+0000","last_became_active":"2024-09-11T08:18:02.396814+0000","last_became_peered":"2024-09-11T08:18:02.396814+0000","last_unstale":"2024-09-11T08:18:08.743622+0000","last_undegraded":"2024-09-11T08:18:08.743622+0000","last_fullsized":"2024-09-11T08:18:08.743622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T08:18:01.365014+0000","last_clean_scrub_stamp":"2024-09-11T08:18:01.365014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:27.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1328,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397527,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298604,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446548,"statfs":{"total":95995035648,"available":95689265152,"internally_reserved":0,"allocated":1282048,"data_stored":871734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.443},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.318},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39500000000000002}]},{"osd":5,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.41299999999999998}]},{"osd":6,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54800000000000004}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298580,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446572,"statfs":{"total":95995035648,"available":95689289728,"internally_reserved":0,"allocated":1257472,"data_stored":870028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.308},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.62,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.39500000000000002}]},{"osd":2,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.63800000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.378}]},{"osd":3,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.29599999999999999}]},{"osd":5,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70699999999999996,"5min":0.753,"15min":0.753},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35299999999999998}]},{"osd":7,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.32300000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789985,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298004,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447148,"statfs":{"total":95995035648,"available":95689879552,"internally_reserved":0,"allocated":663552,"data_stored":279176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49199999999999999,"15min":0.495},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60599999999999998,"5min":0.751,"15min":0.751},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65300000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.495},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.63100000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Sep 11 08:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67400000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.31},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.33300000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57699999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Wed Sep 11 08:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.442},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38100000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986214,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447120,"statfs":{"total":95995035648,"available":95689850880,"internally_reserved":0,"allocated":692224,"data_stored":280356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.745},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49099999999999999,"15min":0.495},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.371}]},{"osd":1,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58799999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.442}]},{"osd":2,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.499,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.43099999999999999}]},{"osd":5,"last update":"Wed Sep 11 08:19:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.312},{"interface":"front","average":{"1min":0.443,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.26100000000000001}]},{"osd":6,"last update":"Wed Sep 11 08:19:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.28399999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34699999999999998}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.39800000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149738,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298040,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447112,"statfs":{"total":95995035648,"available":95689842688,"internally_reserved":0,"allocated":700416,"data_stored":280891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.38,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44900000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.40600000000000003,"15min":0.42799999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47199999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39600000000000002,"15min":0.41399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52400000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Sep 11 08:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.49299999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41999999999999998,"15min":0.442},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.504,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.28000000000000003}]},{"osd":4,"last update":"Wed Sep 11 08:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64200000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77400000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39700000000000002}]},{"osd":5,"last update":"Wed Sep 11 08:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":6,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39000000000000001}]},{"osd":7,"last update":"Wed Sep 11 08:18:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.379}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298004,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447148,"statfs":{"total":95995035648,"available":95689879552,"internally_reserved":0,"allocated":663552,"data_stored":279971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed Sep 11 08:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39600000000000002,"15min":0.40300000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51800000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed Sep 11 08:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.436,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54100000000000004}]},{"osd":4,"last update":"Wed Sep 11 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 11 08:18:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.47199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298064,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447088,"statfs":{"total":95995035648,"available":95689818112,"internally_reserved":0,"allocated":724992,"data_stored":282029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 08:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35599999999999998,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34999999999999998},"min":{"1min":0.245,"5min":0.221,"15min":0.221},"max":{"1min":0.52600000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Sep 11 08:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.50700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.375}]},{"osd":3,"last update":"Wed Sep 11 08:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.498,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Sep 11 08:18:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998}]},{"osd":5,"last update":"Wed Sep 11 08:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.318},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45900000000000002}]},{"osd":6,"last update":"Wed Sep 11 08:19:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Sep 11 08:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.435}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298596,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446556,"statfs":{"total":95995035648,"available":95689273344,"internally_reserved":0,"allocated":1273856,"data_stored":870195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 11 08:18:30 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.33400000000000002,"15min":0.316},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.33000000000000002,"15min":0.30599999999999999},"min":{"1min":0.222,"5min":0.218,"15min":0.218},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Sep 11 08:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.379},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.503,"5min":0.625,"15min":0.625},"last":0.40999999999999998}]},{"osd":3,"last update":"Wed Sep 11 08:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52100000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.438},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 11 08:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Sep 11 08:19:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.57199999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.747,"15min":0.747},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Sep 11 08:19:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Wed Sep 11 08:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.624},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T08:19:32.774 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T08:19:32.775 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T08:19:32.775 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T08:19:32.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9 shell --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T08:19:33.054 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T08:19:33.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:33 smithi173 ceph-mon[29664]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:33 smithi173 ceph-mon[40835]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:33.563 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:33 smithi175 ceph-mon[32813]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T08:19:34.579 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:34 smithi173 ceph-mon[40835]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:34.580 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:34 smithi173 ceph-mon[29664]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:34 smithi175 ceph-mon[32813]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 -- 172.21.15.173:0/397741592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 msgr2=0x7f235c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 --2- 172.21.15.173:0/397741592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c101ba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2350004980 tx=0x7f2350009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 -- 172.21.15.173:0/397741592 shutdown_connections 2024-09-11T08:19:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 --2- 172.21.15.173:0/397741592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 0x7f235c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 --2- 172.21.15.173:0/397741592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 --2- 172.21.15.173:0/397741592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c101ba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 -- 172.21.15.173:0/397741592 >> 172.21.15.173:0/397741592 conn(0x7f235c071c00 msgr2=0x7f235c072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.494+0000 7f2361ede640 1 -- 172.21.15.173:0/397741592 shutdown_connections 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 -- 172.21.15.173:0/397741592 wait complete. 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 Processor -- start 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 -- start start 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 0x7f235c113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c10d510 con 0x7f235c0fb800 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c10d680 con 0x7f235c0fc1b0 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f2361ede640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c10d840 con 0x7f235c1017d0 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49230/0 (socket says 172.21.15.173:49230) 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f235b7fe640 1 -- 172.21.15.173:0/2185966844 learned_addr learned my addr 172.21.15.173:0/2185966844 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.495+0000 7f235bfff640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235affd640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 0x7f235c113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 -- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 msgr2=0x7f235c10cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c10cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 -- 172.21.15.173:0/2185966844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 msgr2=0x7f235c113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 0x7f235c113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 -- 172.21.15.173:0/2185966844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c005040 con 0x7f235c0fb800 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f235b7fe640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f235002d040 tx=0x7f2350035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235002aca0 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f235002ae00 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2350005040 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235003c410 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.496+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c119b30 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.497+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c0662f0 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.498+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f2350030020 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.498+0000 7f2343fff640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 0x7f23440713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.498+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7417+0+0 (secure 0 0 0) 0x7f23500ae6c0 con 0x7f235c0fb800 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.498+0000 7f235affd640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 0x7f23440713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:19:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.499+0000 7f235affd640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 0x7f23440713c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f234c007fd0 tx=0x7f234c009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:19:35.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.502+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f235007b180 con 0x7f235c0fb800 2024-09-11T08:19:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.704+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f235c10aa40 con 0x7f235c0fb800 2024-09-11T08:19:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.704+0000 7f2343fff640 1 -- 172.21.15.173:0/2185966844 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f235007ab20 con 0x7f235c0fb800 2024-09-11T08:19:35.707 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-11T08:19:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 msgr2=0x7f23440713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 0x7f23440713c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f234c007fd0 tx=0x7f234c009da0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 msgr2=0x7f235c112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f235002d040 tx=0x7f2350035040 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 shutdown_connections 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f234406ef10 0x7f23440713c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f235c1017d0 0x7f235c10cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f235c0fc1b0 0x7f235c113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 --2- 172.21.15.173:0/2185966844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235c0fb800 0x7f235c112ce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 >> 172.21.15.173:0/2185966844 conn(0x7f235c071c00 msgr2=0x7f235c0ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:19:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 shutdown_connections 2024-09-11T08:19:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-11T08:19:35.707+0000 7f2361ede640 1 -- 172.21.15.173:0/2185966844 wait complete. 2024-09-11T08:19:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:36.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:36.507 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T08:19:36.508 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T08:19:36.508 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T08:19:36.527 INFO:tasks.workunit:Pulling workunits from ref d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:19:36.527 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T08:19:36.527 DEBUG:teuthology.orchestra.run.smithi173:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T08:19:36.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:19:36.543 INFO:teuthology.orchestra.run.smithi173.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-11T08:19:36.544 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T08:19:36.599 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-11T08:19:36.599 DEBUG:teuthology.orchestra.run.smithi173:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-11T08:19:36.656 INFO:tasks.workunit:timeout=3h 2024-09-11T08:19:36.656 INFO:tasks.workunit:cleanup=True 2024-09-11T08:19:36.656 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d0e6828a2016d48cf25ad84064e50742bb1c39b9 2024-09-11T08:19:36.712 INFO:tasks.workunit.client.0.smithi173.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T08:19:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: osdmap e63: 8 total, 8 up, 8 in 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2185966844' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-09-11T08:19:36.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-11T08:19:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-11T08:19:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-11T08:19:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: osdmap e63: 8 total, 8 up, 8 in 2024-09-11T08:19:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2185966844' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T08:19:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-09-11T08:19:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-11T08:19:37.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-11T08:19:37.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-11T08:19:37.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: osdmap e63: 8 total, 8 up, 8 in 2024-09-11T08:19:37.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2185966844' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T08:19:37.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:37.847 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: osdmap e64: 8 total, 8 up, 8 in 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[29664]: Reconfiguring daemon alertmanager.a on smithi173 2024-09-11T08:19:37.848 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: osdmap e64: 8 total, 8 up, 8 in 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-11T08:19:37.849 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:37 smithi173 ceph-mon[40835]: Reconfiguring daemon alertmanager.a on smithi173 2024-09-11T08:19:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: osdmap e64: 8 total, 8 up, 8 in 2024-09-11T08:19:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-11T08:19:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:37 smithi175 ceph-mon[32813]: Reconfiguring daemon alertmanager.a on smithi173 2024-09-11T08:19:38.866 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:38 smithi173 ceph-mon[40835]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-11T08:19:38.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:38 smithi173 ceph-mon[29664]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-11T08:19:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:38 smithi175 ceph-mon[32813]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-11T08:19:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:39 smithi173 ceph-mon[29664]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:39 smithi173 ceph-mon[40835]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:39 smithi175 ceph-mon[32813]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:19:40.448 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:40 smithi173 systemd[1]: Stopping Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:19:40.717 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:40 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[75713]: ts=2024-09-11T08:19:40.447Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-11T08:19:40.717 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:40 smithi173 podman[78809]: 2024-09-11 08:19:40.46841241 +0000 UTC m=+0.121420581 container died 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:40 smithi175 ceph-mon[32813]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-11T08:19:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:40 smithi175 ceph-mon[32813]: Cluster is now healthy 2024-09-11T08:19:41.216 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:40 smithi173 podman[78809]: 2024-09-11 08:19:40.946011117 +0000 UTC m=+0.599019332 container cleanup 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:41.217 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:40 smithi173 bash[78809]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a 2024-09-11T08:19:41.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:40 smithi173 ceph-mon[29664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-11T08:19:41.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:40 smithi173 ceph-mon[29664]: Cluster is now healthy 2024-09-11T08:19:41.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:40 smithi173 ceph-mon[40835]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-11T08:19:41.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:40 smithi173 ceph-mon[40835]: Cluster is now healthy 2024-09-11T08:19:41.506 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 podman[78826]: 2024-09-11 08:19:41.222806641 +0000 UTC m=+0.750405363 container remove 324f8d4c23fff16280ceedaf92273dd6f4960febbd0f0aae47a4ac881cb434b8 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:41.506 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 podman[78826]: 2024-09-11 08:19:41.30880043 +0000 UTC m=+0.836399104 volume remove 51c38da341a9a21ca387ee69b71f292007ef5240662f2020d57b085ee41773a5 2024-09-11T08:19:41.818 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-11T08:19:41.818 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 systemd[1]: Stopped Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:41.818 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 systemd[1]: Starting Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:19:41.818 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 podman[78926]: 2024-09-11 08:19:41.631944354 +0000 UTC m=+0.016041987 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-09-11T08:19:41.818 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 podman[78926]: 2024-09-11 08:19:41.759964592 +0000 UTC m=+0.144062221 volume create f4447b048f63b61127bc5d76ddc1c2537030a67cce2d61fabcefcf6b4c1e1321 2024-09-11T08:19:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:41 smithi175 ceph-mon[32813]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:42.163 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:41 smithi173 ceph-mon[29664]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:42.163 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:41 smithi173 podman[78926]: 2024-09-11 08:19:41.868937027 +0000 UTC m=+0.253034655 container create 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:42.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:41 smithi173 ceph-mon[40835]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 podman[78926]: 2024-09-11 08:19:42.163202005 +0000 UTC m=+0.547299633 container init 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 podman[78926]: 2024-09-11 08:19:42.168146548 +0000 UTC m=+0.552244176 container start 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.180Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.180Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.181Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.173 port=9094 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.182Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-11T08:19:42.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.205Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-11T08:19:42.468 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.205Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-11T08:19:42.468 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.208Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-11T08:19:42.468 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:42.208Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-11T08:19:42.468 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 bash[78926]: 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 2024-09-11T08:19:42.468 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:42 smithi173 systemd[1]: Started Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:43.575 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:43 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.575 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:43 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.575 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:43 smithi175 ceph-mon[32813]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-11T08:19:43.575 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:43 smithi175 ceph-mon[32813]: Reconfiguring daemon prometheus.a on smithi175 2024-09-11T08:19:43.575 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:43 smithi175 ceph-mon[32813]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[29664]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[29664]: Reconfiguring daemon prometheus.a on smithi175 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[29664]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[40835]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-11T08:19:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[40835]: Reconfiguring daemon prometheus.a on smithi175 2024-09-11T08:19:43.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:43 smithi173 ceph-mon[40835]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 2 objects/s recovering 2024-09-11T08:19:44.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:44 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:44.182Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000212253s 2024-09-11T08:19:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:45.761 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 systemd[1]: Stopping Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:19:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-mon[32813]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 48 B/s, 2 objects/s recovering 2024-09-11T08:19:46.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.812Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.813Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.813Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-11T08:19:46.095 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[63679]: ts=2024-09-11T08:19:45.813Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-11T08:19:46.096 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:45 smithi175 podman[66988]: 2024-09-11 08:19:45.823048998 +0000 UTC m=+0.152002791 container died 2aa48f0ae77f9e0f4ab6aeacfcf7ef17d69db76d9194f062a91239ac18e226fd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:45 smithi173 ceph-mon[29664]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 48 B/s, 2 objects/s recovering 2024-09-11T08:19:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:45 smithi173 ceph-mon[40835]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 48 B/s, 2 objects/s recovering 2024-09-11T08:19:46.594 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:46 smithi175 podman[66988]: 2024-09-11 08:19:46.193096776 +0000 UTC m=+0.522050555 container cleanup 2aa48f0ae77f9e0f4ab6aeacfcf7ef17d69db76d9194f062a91239ac18e226fd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:46.594 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:46 smithi175 bash[66988]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a 2024-09-11T08:19:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:47.969 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:47 smithi175 ceph-mon[32813]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 101 B/s wr, 5 op/s; 43 B/s, 1 objects/s recovering 2024-09-11T08:19:47.969 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 podman[67005]: 2024-09-11 08:19:47.633713112 +0000 UTC m=+1.813025133 container remove 2aa48f0ae77f9e0f4ab6aeacfcf7ef17d69db76d9194f062a91239ac18e226fd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:47.969 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-11T08:19:47.969 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 systemd[1]: Stopped Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:47.969 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@prometheus.a.service: Consumed 1.119s CPU time. 2024-09-11T08:19:47.969 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 systemd[1]: Starting Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:19:48.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:47 smithi173 ceph-mon[29664]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 101 B/s wr, 5 op/s; 43 B/s, 1 objects/s recovering 2024-09-11T08:19:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:47 smithi173 ceph-mon[40835]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 101 B/s wr, 5 op/s; 43 B/s, 1 objects/s recovering 2024-09-11T08:19:48.344 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:47 smithi175 podman[67100]: 2024-09-11 08:19:47.872767716 +0000 UTC m=+0.016851164 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-11T08:19:49.344 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 podman[67100]: 2024-09-11 08:19:49.00351353 +0000 UTC m=+1.147596966 container create 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:49.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:49.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:49.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:49.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:49.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:49.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:49.846 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 podman[67100]: 2024-09-11 08:19:49.589743101 +0000 UTC m=+1.733826538 container init 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:49.846 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 podman[67100]: 2024-09-11 08:19:49.595128252 +0000 UTC m=+1.739211690 container start 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:19:49.846 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.621Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.621Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.621Z caller=main.go:570 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi175 (none))" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.621Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.621Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.622Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.623Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.624Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.624Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.626Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.626Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.008µs 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.626Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-11T08:19:49.847 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.626Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.626Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.627Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.78µs wal_replay_duration=517.68µs wbl_replay_duration=96ns total_replay_duration=563.656µs 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.627Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.627Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.627Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.643Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.471367ms db_storage=926ns remote_storage=1.51µs web_handler=261ns query_engine=713ns scrape=626.719µs scrape_sd=27.627µs notify=210.251µs notify_sd=19.934µs rules=14.267245ms tracing=6.879µs 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.643Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:19:49.643Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 bash[67100]: 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 2024-09-11T08:19:49.848 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:19:49 smithi175 systemd[1]: Started Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:19:50.076 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:49] ENGINE Bus STOPPING 2024-09-11T08:19:50.076 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-11T08:19:50.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:50.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.078 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:50.079 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:50.079 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:50.079 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:50.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STOPPED 2024-09-11T08:19:50.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STARTING 2024-09-11T08:19:50.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Serving on http://:::9283 2024-09-11T08:19:50.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STARTED 2024-09-11T08:19:50.425 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STOPPING 2024-09-11T08:19:50.683 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-11T08:19:50.684 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STOPPED 2024-09-11T08:19:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[29664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STARTING 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Serving on http://:::9283 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STARTED 2024-09-11T08:19:50.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:50] ENGINE Bus STOPPING 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:50 smithi173 ceph-mon[40835]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T08:19:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi173.front.sepia.ceph.com:9093"}]: dispatch 2024-09-11T08:19:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T08:19:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi175.front.sepia.ceph.com:9095"}]: dispatch 2024-09-11T08:19:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T08:19:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:50 smithi175 ceph-mon[32813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi175.front.sepia.ceph.com:3000"}]: dispatch 2024-09-11T08:19:51.630 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-11T08:19:51.630 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:51] ENGINE Bus STOPPED 2024-09-11T08:19:51.630 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:51] ENGINE Bus STARTING 2024-09-11T08:19:51.630 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:51] ENGINE Serving on http://:::9283 2024-09-11T08:19:51.631 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:19:51] ENGINE Bus STARTED 2024-09-11T08:19:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-mon[29664]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:51 smithi173 ceph-mon[40835]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:52.015 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:51 smithi175 ceph-mon[32813]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s; 36 B/s, 1 objects/s recovering 2024-09-11T08:19:52.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:19:52 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:19:52.185Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002943335s 2024-09-11T08:19:53.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[40835]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:53 smithi173 ceph-mon[29664]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:53 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:53 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:53 smithi175 ceph-mon[32813]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:55.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:55.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:55.393 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:55.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:55 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:19:56.080 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:19:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:19:56.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:56 smithi175 ceph-mon[32813]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:56.399 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:56 smithi173 ceph-mon[29664]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:56.399 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:56 smithi173 ceph-mon[40835]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:19:57.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:57.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:57.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:19:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:19:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:19:57] "GET /metrics HTTP/1.1" 200 219806 "" "Prometheus/2.43.0" 2024-09-11T08:19:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:58 smithi175 ceph-mon[32813]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:58 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:58 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:58.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[29664]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:58.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:58.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[40835]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:19:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:19:58.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:58 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:20:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:20:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:19:59 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:20:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:20:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:20:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:19:59 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:00 smithi175 ceph-mon[32813]: overall HEALTH_OK 2024-09-11T08:20:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:00 smithi173 ceph-mon[29664]: overall HEALTH_OK 2024-09-11T08:20:01.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:00 smithi173 ceph-mon[40835]: overall HEALTH_OK 2024-09-11T08:20:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:01 smithi175 ceph-mon[32813]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:01 smithi173 ceph-mon[29664]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:01 smithi173 ceph-mon[40835]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:03 smithi175 ceph-mon[32813]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:03 smithi173 ceph-mon[29664]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:03 smithi173 ceph-mon[40835]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:05 smithi175 ceph-mon[32813]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:06.095 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:05 smithi173 ceph-mon[29664]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:05 smithi173 ceph-mon[40835]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:07.824 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:07] "GET /metrics HTTP/1.1" 200 219798 "" "Prometheus/2.43.0" 2024-09-11T08:20:07.824 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:07 smithi173 ceph-mon[29664]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:07 smithi175 ceph-mon[32813]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:08.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:07 smithi173 ceph-mon[40835]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:09 smithi175 ceph-mon[32813]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:09 smithi173 ceph-mon[29664]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:09 smithi173 ceph-mon[40835]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:11 smithi175 ceph-mon[32813]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:11 smithi173 ceph-mon[29664]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:11 smithi173 ceph-mon[40835]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:13 smithi175 ceph-mon[32813]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:13 smithi173 ceph-mon[29664]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:13 smithi173 ceph-mon[40835]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:15 smithi175 ceph-mon[32813]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:16.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:16.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:15 smithi173 ceph-mon[29664]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:15 smithi173 ceph-mon[40835]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:17.841 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:17] "GET /metrics HTTP/1.1" 200 219798 "" "Prometheus/2.43.0" 2024-09-11T08:20:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:17 smithi175 ceph-mon[32813]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:18.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:17 smithi173 ceph-mon[29664]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:17 smithi173 ceph-mon[40835]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:19 smithi175 ceph-mon[32813]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:19 smithi173 ceph-mon[29664]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:19 smithi173 ceph-mon[40835]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:22.168 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:21 smithi175 ceph-mon[32813]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:21 smithi173 ceph-mon[29664]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:22.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:21 smithi173 ceph-mon[40835]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:24.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:23 smithi173 ceph-mon[29664]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:23 smithi173 ceph-mon[40835]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:24.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:23 smithi175 ceph-mon[32813]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:25 smithi175 ceph-mon[32813]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:26.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:26.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:25 smithi173 ceph-mon[29664]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:25 smithi173 ceph-mon[40835]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:27.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:27.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:27.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:27.859 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:27] "GET /metrics HTTP/1.1" 200 219762 "" "Prometheus/2.43.0" 2024-09-11T08:20:27.860 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:27 smithi173 ceph-mon[40835]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:27.860 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:27 smithi173 ceph-mon[29664]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:27 smithi175 ceph-mon[32813]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:29 smithi173 ceph-mon[29664]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:29 smithi173 ceph-mon[40835]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:29 smithi175 ceph-mon[32813]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:31 smithi173 ceph-mon[29664]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:31 smithi173 ceph-mon[40835]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:31 smithi175 ceph-mon[32813]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:34.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:33 smithi173 ceph-mon[29664]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:33 smithi173 ceph-mon[40835]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:34.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:33 smithi175 ceph-mon[32813]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:34 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:34 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:34 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:35.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:35 smithi175 ceph-mon[32813]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:36.095 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:35 smithi173 ceph-mon[29664]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:36.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:35 smithi173 ceph-mon[40835]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:37.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:37.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:Note: switching to 'd0e6828a2016d48cf25ad84064e50742bb1c39b9'. 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T08:20:37.355 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: git switch -c 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr:Or undo this operation with: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: git switch - 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr: 2024-09-11T08:20:37.356 INFO:tasks.workunit.client.0.smithi173.stderr:HEAD is now at d0e6828a201 Merge branch 'wip-63919-quincy' of https://github.com/guits/ceph into wip-guits-quincy-2024-09-10-2008-quincy 2024-09-11T08:20:37.362 DEBUG:teuthology.orchestra.run.smithi173:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T08:20:37.386 INFO:tasks.workunit.client.0.smithi173.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T08:20:37.388 INFO:tasks.workunit.client.0.smithi173.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T08:20:37.388 INFO:tasks.workunit.client.0.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T08:20:37.878 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:37] "GET /metrics HTTP/1.1" 200 219768 "" "Prometheus/2.43.0" 2024-09-11T08:20:38.027 INFO:tasks.workunit.client.0.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T08:20:38.100 INFO:tasks.workunit.client.0.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T08:20:38.140 INFO:tasks.workunit.client.0.smithi173.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T08:20:38.142 INFO:tasks.workunit.client.0.smithi173.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T08:20:38.142 INFO:tasks.workunit.client.0.smithi173.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T08:20:38.180 INFO:tasks.workunit.client.0.smithi173.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T08:20:38.183 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-11T08:20:38.183 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T08:20:38.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:37 smithi173 ceph-mon[29664]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:37 smithi173 ceph-mon[40835]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:38.232 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-11T08:20:38.233 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-11T08:20:38.233 DEBUG:teuthology.orchestra.run.smithi173:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d0e6828a2016d48cf25ad84064e50742bb1c39b9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-09-11T08:20:38.293 INFO:tasks.workunit.client.0.smithi173.stderr:+ parallel=1 2024-09-11T08:20:38.293 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' '' = --serial ']' 2024-09-11T08:20:38.293 INFO:tasks.workunit.client.0.smithi173.stderr:+ color= 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -t 1 ']' 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ declare -A pids 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_aio 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_aio' 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_aio 2024-09-11T08:20:38.294 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.295 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_aio 2024-09-11T08:20:38.295 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80268 2024-09-11T08:20:38.295 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_aio on pid 80268' 2024-09-11T08:20:38.295 INFO:tasks.workunit.client.0.smithi173.stdout:test api_aio on pid 80268 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80268 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_aio_pp 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_aio_pp' 2024-09-11T08:20:38.299 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_aio_pp 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.300 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.301 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_aio_pp 2024-09-11T08:20:38.302 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80275 2024-09-11T08:20:38.302 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_aio_pp on pid 80275' 2024-09-11T08:20:38.302 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80275 2024-09-11T08:20:38.302 INFO:tasks.workunit.client.0.smithi173.stdout:test api_aio_pp on pid 80275 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_io 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_io' 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_io 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.306 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.307 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.308 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.309 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.310 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.310 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_io 2024-09-11T08:20:38.310 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80284 2024-09-11T08:20:38.310 INFO:tasks.workunit.client.0.smithi173.stdout:test api_io on pid 80284 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_io on pid 80284' 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80284 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_io_pp 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_io_pp' 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_io_pp 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.315 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.316 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.317 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.318 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.319 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.320 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.320 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.320 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_io_pp 2024-09-11T08:20:38.320 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80295 2024-09-11T08:20:38.320 INFO:tasks.workunit.client.0.smithi173.stdout:test api_io_pp on pid 80295 2024-09-11T08:20:38.325 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_io_pp on pid 80295' 2024-09-11T08:20:38.325 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80295 2024-09-11T08:20:38.325 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-09-11T08:20:38.325 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.325 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_asio 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_asio' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_asio 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.326 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.327 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.328 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.329 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.330 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_asio 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80310 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_asio on pid 80310' 2024-09-11T08:20:38.331 INFO:tasks.workunit.client.0.smithi173.stdout:test api_asio on pid 80310 2024-09-11T08:20:38.337 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80310 2024-09-11T08:20:38.337 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.337 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.337 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-09-11T08:20:38.337 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_list 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_list' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_list 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.338 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.339 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.340 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.341 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.342 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.343 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.344 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.345 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_list 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80326 2024-09-11T08:20:38.346 INFO:tasks.workunit.client.0.smithi173.stdout:test api_list on pid 80326 2024-09-11T08:20:38.348 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:37 smithi175 ceph-mon[32813]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_list on pid 80326' 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80326 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80268/exe 2024-09-11T08:20:38.353 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_lock 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_lock' 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_lock 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.354 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.355 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.356 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.357 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.358 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80275/exe 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.359 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.360 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.361 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_aio 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_aio: /' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_aio.log 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.362 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_lock 2024-09-11T08:20:38.363 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80348 2024-09-11T08:20:38.363 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_lock on pid 80348' 2024-09-11T08:20:38.363 INFO:tasks.workunit.client.0.smithi173.stdout:test api_lock on pid 80348 2024-09-11T08:20:38.365 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80348 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_lock_pp 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.366 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_lock_pp' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_lock_pp 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.367 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_aio_pp 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.368 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.369 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.370 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.371 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.372 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80284/exe 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.373 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.374 INFO:tasks.workunit.client.0.smithi173.stdout:test api_lock_pp on pid 80366 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_lock_pp 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80366 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_lock_pp on pid 80366' 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80366 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.377 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_aio_pp: /' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_misc 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_misc' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.378 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.379 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_io 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_io.log 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.380 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_misc 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.381 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_io: /' 2024-09-11T08:20:38.382 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.383 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.384 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.385 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80295/exe 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.386 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.387 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.387 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.387 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_misc 2024-09-11T08:20:38.387 INFO:tasks.workunit.client.0.smithi173.stdout:test api_misc on pid 80390 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80390 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_misc on pid 80390' 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80390 2024-09-11T08:20:38.392 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.393 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_io_pp 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.394 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_io_pp: /' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.395 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.396 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.397 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_misc_pp 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.398 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_misc_pp' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80310/exe 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.399 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.400 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.401 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.402 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_asio: /' 2024-09-11T08:20:38.403 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_asio 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_asio.log 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.404 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.405 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.406 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80326/exe 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.407 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.408 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.409 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80348/exe 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.410 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_list 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.411 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.412 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_list.log 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_lock: /' 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_lock 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.413 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.414 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.415 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.416 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80366/exe 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_list: /' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.417 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.418 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_misc_pp 2024-09-11T08:20:38.418 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.418 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_lock.log 2024-09-11T08:20:38.418 INFO:tasks.workunit.client.0.smithi173.stdout:test api_misc_pp on pid 80452 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_misc_pp 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80452 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_misc_pp on pid 80452' 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80452 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.420 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_tier_pp 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_tier_pp' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.421 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_tier_pp 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-09-11T08:20:38.422 INFO:tasks.workunit.client.0.smithi173.stdout:test api_tier_pp on pid 80461 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_tier_pp 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_lock_pp 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80461 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_tier_pp on pid 80461' 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80461 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.424 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_lock_pp: /' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_pool 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_pool' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_pool 2024-09-11T08:20:38.425 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.426 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.427 INFO:tasks.workunit.client.0.smithi173.stdout:test api_pool on pid 80495 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_pool 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.430 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80495 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_pool on pid 80495' 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80495 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.431 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_snapshots 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_snapshots' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_snapshots 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.432 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.433 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.434 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.435 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.436 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.437 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.438 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.439 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.440 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80390/exe 2024-09-11T08:20:38.440 INFO:tasks.workunit.client.0.smithi173.stdout:test api_snapshots on pid 80544 2024-09-11T08:20:38.444 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.444 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_snapshots 2024-09-11T08:20:38.444 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80544 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_snapshots on pid 80544' 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80544 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.445 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.446 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_misc 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_snapshots_pp 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.447 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_snapshots_pp' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.448 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_snapshots_pp 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_misc.log 2024-09-11T08:20:38.449 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_misc: /' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.450 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.451 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.452 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_snapshots_pp 2024-09-11T08:20:38.453 INFO:tasks.workunit.client.0.smithi173.stdout:test api_snapshots_pp on pid 80588 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80588 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_snapshots_pp on pid 80588' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80588 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.456 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_stat 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_stat' 2024-09-11T08:20:38.457 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.458 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.459 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.460 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_stat 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.461 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.462 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.463 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.464 INFO:tasks.workunit.client.0.smithi173.stdout:test api_stat on pid 80621 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_stat 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.466 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80452/exe 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80621 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_stat on pid 80621' 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80621 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.467 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_stat_pp 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_stat_pp' 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_stat_pp 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.468 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.469 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.470 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.471 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.471 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.471 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_misc_pp: /' 2024-09-11T08:20:38.471 INFO:tasks.workunit.client.0.smithi173.stdout:test api_stat_pp on pid 80635 2024-09-11T08:20:38.474 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.474 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.474 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_misc_pp 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_stat_pp 2024-09-11T08:20:38.475 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.476 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80635 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_stat_pp on pid 80635' 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80635 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.477 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_watch_notify 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_watch_notify' 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.478 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.479 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.480 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.481 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80495/exe 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.482 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_watch_notify 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.483 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.484 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80461/exe 2024-09-11T08:20:38.485 INFO:tasks.workunit.client.0.smithi173.stdout:test api_watch_notify on pid 80662 2024-09-11T08:20:38.487 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_watch_notify 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80662 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_watch_notify on pid 80662' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80662 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.488 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.489 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_watch_notify_pp 2024-09-11T08:20:38.490 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_pool 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_watch_notify_pp' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_pool: /' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.491 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.492 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_tier_pp: /' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.493 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.494 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_pool.log 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80544/exe 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.495 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_watch_notify_pp 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.496 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.497 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.498 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_tier_pp 2024-09-11T08:20:38.499 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.499 INFO:tasks.workunit.client.0.smithi173.stdout:test api_watch_notify_pp on pid 80684 2024-09-11T08:20:38.504 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_watch_notify_pp 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80684 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_watch_notify_pp on pid 80684' 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80684 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.505 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_snapshots: /' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_snapshots 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_cmd 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_cmd' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.506 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.507 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.508 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.509 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.510 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_cmd 2024-09-11T08:20:38.511 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_cmd 2024-09-11T08:20:38.512 INFO:tasks.workunit.client.0.smithi173.stdout:test api_cmd on pid 80703 2024-09-11T08:20:38.518 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80703 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_cmd on pid 80703' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80703 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.519 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.520 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.521 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.522 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.523 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.524 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.525 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.526 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.527 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.528 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_cmd_pp 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.529 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80588/exe 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_cmd_pp' 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.530 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.531 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.532 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.533 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.534 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80662/exe 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.535 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.536 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_watch_notify: /' 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_watch_notify 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80635/exe 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.537 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.538 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_stat_pp: /' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_cmd_pp 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.539 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_stat_pp 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.540 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.541 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.542 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_cmd_pp 2024-09-11T08:20:38.543 INFO:tasks.workunit.client.0.smithi173.stdout:test api_cmd_pp on pid 80781 2024-09-11T08:20:38.546 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80781 2024-09-11T08:20:38.546 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_cmd_pp on pid 80781' 2024-09-11T08:20:38.546 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80781 2024-09-11T08:20:38.546 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.546 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.547 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_service 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_service' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.548 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.549 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.550 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80621/exe 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.551 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_stat: /' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_stat.log 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_stat 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.552 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_service 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.553 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80703/exe 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.554 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.555 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.556 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.557 INFO:tasks.workunit.client.0.smithi173.stdout:test api_service on pid 80833 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_service 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80833 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_service on pid 80833' 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80833 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.561 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_cmd 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_cmd: /' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_cmd.log 2024-09-11T08:20:38.562 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.563 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_service_pp 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_service_pp' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.564 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.565 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.566 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.567 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80684/exe 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.568 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.569 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.570 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.571 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80781/exe 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.572 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_service_pp 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_service_pp 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.573 INFO:tasks.workunit.client.0.smithi173.stdout:test api_service_pp on pid 80899 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80899 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_service_pp on pid 80899' 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80899 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.575 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.576 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_c_write_operations 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_c_write_operations' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.577 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_c_write_operations 2024-09-11T08:20:38.578 INFO:tasks.workunit.client.0.smithi173.stdout:test api_c_write_operations on pid 80922 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_c_write_operations 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80922 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_c_write_operations on pid 80922' 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80922 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_c_read_operations 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_c_read_operations' 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.580 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_c_read_operations 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.581 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.582 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.583 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.584 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.584 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.584 INFO:tasks.workunit.client.0.smithi173.stdout:test api_c_read_operations on pid 80940 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_c_read_operations 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80940 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_c_read_operations on pid 80940' 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80940 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.588 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.589 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.590 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.591 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.592 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.593 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80833/exe 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.594 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_service 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_service.log 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s api_cls_remote_reads 2024-09-11T08:20:38.595 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' api_cls_remote_reads' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo api_cls_remote_reads 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.596 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.597 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.598 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.599 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.599 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.599 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.599 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_service: /' 2024-09-11T08:20:38.599 INFO:tasks.workunit.client.0.smithi173.stdout:test api_cls_remote_reads on pid 80983 2024-09-11T08:20:38.601 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=api_cls_remote_reads 2024-09-11T08:20:38.601 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80983 2024-09-11T08:20:38.601 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test api_cls_remote_reads on pid 80983' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=80983 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s list_parallel 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.602 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' list_parallel' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.603 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.604 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo list_parallel 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.605 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.606 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.607 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.608 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.609 INFO:tasks.workunit.client.0.smithi173.stdout:test list_parallel on pid 81012 2024-09-11T08:20:38.610 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.610 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=list_parallel 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.611 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81012 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test list_parallel on pid 81012' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=81012 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-09-11T08:20:38.612 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.613 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s open_pools_parallel 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' open_pools_parallel' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80899/exe 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo open_pools_parallel 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.614 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.615 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.616 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_service_pp 2024-09-11T08:20:38.617 INFO:tasks.workunit.client.0.smithi173.stdout:test open_pools_parallel on pid 81032 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=open_pools_parallel 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81032 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test open_pools_parallel on pid 81032' 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=81032 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-09-11T08:20:38.619 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:++ printf %25s delete_pools_parallel 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+ r=' delete_pools_parallel' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_service_pp: /' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:++ awk '{print $1}' 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:++ echo delete_pools_parallel 2024-09-11T08:20:38.620 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.621 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.622 INFO:tasks.workunit.client.0.smithi173.stderr:+ ff=delete_pools_parallel 2024-09-11T08:20:38.623 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81053 2024-09-11T08:20:38.623 INFO:tasks.workunit.client.0.smithi173.stdout:test delete_pools_parallel on pid 81053 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo 'test delete_pools_parallel on pid 81053' 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ pids[$f]=81053 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ ret=0 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80461 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80461 2024-09-11T08:20:38.631 INFO:tasks.workunit.client.0.smithi173.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -f /etc/bashrc ']' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+ . /etc/bashrc 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -z '' ']' 2024-09-11T08:20:38.632 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ BASHRCSOURCED=Y 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ shopt -q login_shell 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.633 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.634 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.635 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ umask 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.636 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' 0022 -eq 0 ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ SHELL=/bin/bash 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.637 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/bash_completion.sh 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.638 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/cobbler.sh 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorgrep.sh 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.639 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.640 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.641 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.642 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.643 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80940/exe 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80922/exe 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.644 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'grep=grep --color=auto' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'egrep=egrep --color=auto' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorls.sh 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' '!' -t 0 ']' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:+++ return 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-09-11T08:20:38.645 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export S_COLORS=auto 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ S_COLORS=auto 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.646 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.647 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.648 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.649 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.650 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.651 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ /usr/libexec/grepconf.sh -c 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.652 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/81012/exe 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.653 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.654 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ list_parallel: /' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.655 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_list_parallel 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.656 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/debuginfod.sh 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_list_parallel.log 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/gawk.sh 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/lang.sh 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/locale 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.657 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG_backup=en_US.UTF-8 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /etc/locale.conf ']' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -x /usr/bin/sed ']' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.658 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.659 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:++++ export LANG=en_US.UTF-8 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:++++ LANG=en_US.UTF-8 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ LANG=en_US.UTF-8 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ unset LANG_backup config 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n '' ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-09-11T08:20:38.660 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' dumb = linux ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/less.sh 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ for i in /etc/profile.d/*.sh 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ '[' '' ']' 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++ . /etc/profile.d/which2.sh 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/80983/exe 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.661 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/81032/exe 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++++ readlink /proc/81053/exe 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:++++ basename /usr/bin/bash 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-09-11T08:20:38.662 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_declare='declare -f' 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ which_opt=-f 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export which_declare 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+++ export -f which 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset i 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:++ unset -f pathmunge 2024-09-11T08:20:38.663 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ export PATH 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ unset rc 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-09-11T08:20:38.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-09-11T08:20:38.665 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-11T08:20:38.665 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-11T08:20:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1206114594' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-11T08:20:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1206114594' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-11T08:20:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1206114594' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-09-11T08:20:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3398225403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:40 smithi175 ceph-mon[32813]: osdmap e65: 8 total, 8 up, 8 in 2024-09-11T08:20:40.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3398225403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:40 smithi173 ceph-mon[29664]: osdmap e65: 8 total, 8 up, 8 in 2024-09-11T08:20:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3398225403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:40 smithi173 ceph-mon[40835]: osdmap e65: 8 total, 8 up, 8 in 2024-09-11T08:20:44.241 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-09-11T08:20:44.242 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [----------] Global test environment set-up. 2024-09-11T08:20:44.242 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [----------] 12 tests from AsioRados 2024-09-11T08:20:44.242 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-09-11T08:20:44.242 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-09-11T08:20:44.243 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1 ms) 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1 ms) 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-11T08:20:44.244 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-11T08:20:44.245 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [----------] 12 tests from AsioRados (10 ms total) 2024-09-11T08:20:44.246 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: 2024-09-11T08:20:44.247 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [----------] Global test environment tear-down 2024-09-11T08:20:44.247 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (5862 ms total) 2024-09-11T08:20:44.247 INFO:tasks.workunit.client.0.smithi173.stdout: api_asio: [ PASSED ] 12 tests. 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2136009901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2596812791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4209114000' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1513231222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: pgmap v70: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: osdmap e66: 8 total, 8 up, 8 in 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: osdmap e67: 8 total, 8 up, 8 in 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3431516838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2136009901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2596812791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4209114000' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1513231222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: pgmap v70: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: osdmap e66: 8 total, 8 up, 8 in 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: osdmap e67: 8 total, 8 up, 8 in 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3431516838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2136009901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2596812791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4209114000' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1513231222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: pgmap v70: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: osdmap e66: 8 total, 8 up, 8 in 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi173-80353-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: osdmap e67: 8 total, 8 up, 8 in 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3431516838' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:44.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] Global test environment set-up. 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 7 tests from LibRadosList 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.ListObjects (306 ms) 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-11T08:20:45.697 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (33 ms) 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo1,foo2,foo3 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo1 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo2 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo3 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo1,foo4,foo5 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo4 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo5 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo1 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo6,foo7 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo7 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo6 2024-09-11T08:20:45.698 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo4 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo5 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns2:foo7 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns2:foo6 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo1 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo1 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo2 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo3 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (76 ms) 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 1 0 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 10 0 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 13 0 2024-09-11T08:20:45.699 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 7 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 14 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 0 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 15 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 11 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 5 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 8 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 6 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 3 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 4 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 12 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 9 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 2 0 2024-09-11T08:20:45.700 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (61 ms) 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: x cursor=MIN 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=1 cursor=30:02547ec2:::1:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=10 cursor=30:52ea6a34:::10:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=13 cursor=30:566253c9:::13:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=7 cursor=30:5c6b0b28:::7:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=14 cursor=30:62a1935d:::14:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=0 cursor=30:6cac518f:::0:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=15 cursor=30:863748b0:::15:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=11 cursor=30:89d3ae78:::11:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=5 cursor=30:b29083e3:::5:head 2024-09-11T08:20:45.701 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=8 cursor=30:bd63b0f1:::8:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=6 cursor=30:c4fdafeb:::6:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=3 cursor=30:cfc208b3:::3:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=4 cursor=30:d83876eb:::4:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=12 cursor=30:de5d7c5f:::12:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=9 cursor=30:e960b815:::9:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > oid=2 cursor=30:f905c69b:::2:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: FIRST> seek to MIN oid=1 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=1 cursor=30:02547ec2:::1:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:02547ec2:::1:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:02547ec2:::1:head -> 1 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=10 cursor=30:52ea6a34:::10:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:52ea6a34:::10:head 2024-09-11T08:20:45.702 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:52ea6a34:::10:head -> 10 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=13 cursor=30:566253c9:::13:head 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:566253c9:::13:head 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:566253c9:::13:head -> 13 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=7 cursor=30:5c6b0b28:::7:head 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:5c6b0b28:::7:head 2024-09-11T08:20:45.703 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:5c6b0b28:::7:head -> 7 2024-09-11T08:20:45.757 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=14 cursor=30:62a1935d:::14:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:62a1935d:::14:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:62a1935d:::14:head -> 14 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=0 cursor=30:6cac518f:::0:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:6cac518f:::0:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:6cac518f:::0:head -> 0 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=15 cursor=30:863748b0:::15:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:863748b0:::15:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:863748b0:::15:head -> 15 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=11 cursor=30:89d3ae78:::11:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:89d3ae78:::11:head 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:89d3ae78:::11:head -> 11 2024-09-11T08:20:45.758 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=5 cursor=30:b29083e3:::5:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:b29083e3:::5:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:b29083e3:::5:head -> 5 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=8 cursor=30:bd63b0f1:::8:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:bd63b0f1:::8:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:bd63b0f1:::8:head -> 8 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=6 cursor=30:c4fdafeb:::6:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:c4fdafeb:::6:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:c4fdafeb:::6:head -> 6 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=3 cursor=30:cfc208b3:::3:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:cfc208b3:::3:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:cfc208b3:::3:head -> 3 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=4 cursor=30:d83876eb:::4:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:d83876eb:::4:head 2024-09-11T08:20:45.759 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:d83876eb:::4:head -> 4 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=12 cursor=30:de5d7c5f:::12:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:de5d7c5f:::12:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:de5d7c5f:::12:head -> 12 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=9 cursor=30:e960b815:::9:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:e960b815:::9:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:e960b815:::9:head -> 9 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : oid=2 cursor=30:f905c69b:::2:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:f905c69b:::2:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:f905c69b:::2:head -> 2 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:52ea6a34:::10:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:52ea6a34:::10:head expected=30:52ea6a34:::10:head 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:52ea6a34:::10:head -> 10 2024-09-11T08:20:45.760 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=10 expected=10 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:566253c9:::13:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:566253c9:::13:head expected=30:566253c9:::13:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:566253c9:::13:head -> 13 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=13 expected=13 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:de5d7c5f:::12:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:de5d7c5f:::12:head expected=30:de5d7c5f:::12:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:de5d7c5f:::12:head -> 12 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=12 expected=12 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:d83876eb:::4:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:d83876eb:::4:head expected=30:d83876eb:::4:head 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:d83876eb:::4:head -> 4 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=4 expected=4 2024-09-11T08:20:45.761 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:cfc208b3:::3:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:cfc208b3:::3:head expected=30:cfc208b3:::3:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:cfc208b3:::3:head -> 3 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=3 expected=3 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:bd63b0f1:::8:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:bd63b0f1:::8:head expected=30:bd63b0f1:::8:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:bd63b0f1:::8:head -> 8 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=8 expected=8 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:b29083e3:::5:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:b29083e3:::5:head expected=30:b29083e3:::5:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:b29083e3:::5:head -> 5 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=5 expected=5 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:89d3ae78:::11:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:89d3ae78:::11:head expected=30:89d3ae78:::11:head 2024-09-11T08:20:45.762 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:89d3ae78:::11:head -> 11 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: api_list list_parallel: process_1_[81174]: starting. 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: creating pool ceph_test_rados_list_parallel.smithi173-81106 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: created object 0... 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: created object 25... 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: created object 49... 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: finishing. 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_1_[81174]: shutting down. 2024-09-11T08:20:45.910 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: starting. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: listing objects. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: listed object 0... 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: listed object 25... 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: saw 50 objects 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_2_[81175]: shutting down. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: starting. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: creating pool ceph_test_rados_list_parallel.smithi173-81106 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: created object 0... 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: created object 25... 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: created object 49... 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: finishing. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_3_[81841]: shutting down. 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.911 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: starting. 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: listing objects. 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: listed object 0... 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: listed object 25... 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: saw 42 objects 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_4_[81842]: shutting down. 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: starting. 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: removed 25 objects... 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: removed half of the objects 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: removed 50 objects... 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: removed 50 objects 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_5_[81843]: shutting down. 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.912 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: starting. 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: creating pool ceph_test_rados_list_parallel.smithi173-81106 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: created object 0... 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: created object 25... 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: created object 49... 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: finishing. 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_6_[81889]: shutting down. 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: starting. 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: added 25 objects... 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: added half of the objects 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: added 50 objects... 2024-09-11T08:20:45.913 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: added 50 objects 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_8_[81891]: shutting down. 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: starting. 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: listing objects. 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: listed object 0... 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: listed object 25... 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: listed object 50... 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: listed object 75... 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: saw 95 objects 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_7_[81890]: shutting down. 2024-09-11T08:20:45.914 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: pgmap v71: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/709003278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2029004645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/374470203' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3255660219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/167029907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2906746570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3332805933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4085088474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: Health check failed: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/379785666' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.097 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.098 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.099 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: osdmap e68: 8 total, 8 up, 8 in 2024-09-11T08:20:46.099 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.099 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: pgmap v71: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/709003278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2029004645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/374470203' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3255660219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/167029907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2906746570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3332805933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4085088474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: Health check failed: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.220 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/379785666' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.221 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.222 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: pgmap v71: 388 pgs: 166 creating+peering, 90 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/709003278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2029004645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/374470203' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3255660219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/167029907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2906746570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3332805933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4085088474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: Health check failed: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:46.223 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.224 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/379785666' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.225 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.226 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: osdmap e68: 8 total, 8 up, 8 in 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.227 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: osdmap e68: 8 total, 8 up, 8 in 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.228 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:46.443 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: *************** api_cmd_pp: Running main() from gmock_main.cc 2024-09-11T08:20:46.443 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-09-11T08:20:46.443 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-09-11T08:20:46.443 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (36 ms) 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (54 ms) 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (7845 ms) 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (7935 ms total) 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (7935 ms total) 2024-09-11T08:20:46.444 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-09-11T08:20:46.450 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (199 ms) 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (21 ms) 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (9 ms) 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-09-11T08:20:46.451 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (23 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (22 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (12 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (7 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (7 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (4 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (7 ms) 2024-09-11T08:20:46.452 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (15 ms) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (15 ms) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (13 ms) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (4 ms) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (364 ms total) 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-09-11T08:20:46.453 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (7880 ms total) 2024-09-11T08:20:46.454 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2024-09-11T08:20:46.464 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-09-11T08:20:46.464 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-09-11T08:20:46.464 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (7820 ms) 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (7820 ms total) 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (7821 ms total) 2024-09-11T08:20:46.465 INFO:tasks.workunit.client.0.smithi173.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: Running main() from gmock_main.cc 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [----------] Global test environment set-up. 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (54 ms) 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-09-11T08:20:46.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (49 ms) 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7876 ms) 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.133554+0000 mon.b [INF] from='client.? 172.21.15.173:0/709003278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.135591+0000 mon.b [INF] from='client.? 172.21.15.173:0/2029004645' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.137160+0000 mon.b [INF] from='client.? 172.21.15.173:0/374470203' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.139009+0000 mon.b [INF] from='client.? 172.21.15.173:0/3255660219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.144495+0000 mon.c [INF] from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.145899+0000 mon.c [INF] from='client.? 172.21.15.173:0/167029907' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.149400+0000 mon.c [INF] from='client.? 172.21.15.173:0/2906746570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.149599+0000 mon.c [INF] from='client.? 172.21.15.173:0/3332805933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.152202+0000 mon.c [INF] from='client.? 172.21.15.173:0/4085088474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.404191+0000 mon.a [WRN] Health check failed: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.404720+0000 mon.a [INF] from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.412061+0000 mon.a [INF] from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.412311+0000 mon.a [INF] from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.415304+0000 mon.a [INF] from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.415664+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.416580+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.416935+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.417220+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.417729+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.418011+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.418437+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.418782+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.419404+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:44.419808+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.132504+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.132648+0000 mon.a [INF] from='client.? 172.21.15.173:0/1896209932' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi173-80342-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.132725+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi173-80458-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.132829+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi173-80373-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133014+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133101+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi173-80428-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133235+0000 mon.a [INF] from='client.? 172.21.15.173:0/4236532815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi173-80392-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133291+0000 mon.a [INF] from='client.? 172.21.15.173:0/2185855417' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi173-80733-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133352+0000 mon.a [INF] from='client.? 172.21.15.173:0/3351091171' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi173-80812-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.530 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133398+0000 mon.a [INF] from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi173-80423-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133471+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133590+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80829-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133647+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi173-81091-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133702+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi173-80673-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133761+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80896-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133832+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi173-80768-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133926+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.531 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.133985+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi173-80748-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.134065+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "o**************** 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: starting. 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: creating pool ceph_test_rados_list_parallel.smithi173-81106 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: created object 0... 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: created object 25... 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: created object 49... 2024-09-11T08:20:46.549 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: finishing. 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_9_[81939]: shutting down. 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: starting. 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listing objects. 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listed object 0... 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listed object 25... 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listed object 50... 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listed object 75... 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: listed object 100... 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: saw 105 objects 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_10_[81940]: shutting down. 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.550 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: starting. 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: added 25 objects... 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: added half of the objects 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: added 50 objects... 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: added 50 objects 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_11_[81941]: shutting down. 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: starting. 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: added 25 objects... 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: added half of the objects 2024-09-11T08:20:46.551 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: added 50 objects... 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: added 50 objects 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_12_[81942]: shutting down. 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: starting. 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: removed 25 objects... 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: removed half of the objects 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: removed 50 objects... 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: removed 50 objects 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_13_[81943]: shutting down. 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.552 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: starting. 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: creating pool ceph_test_rados_list_parallel.smithi173-81106 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: created object 0... 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: created object 25... 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: created object 49... 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: finishing. 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_14_[82020]: shutting down. 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:46.553 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: starting. 2024-09-11T08:20:47.306 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listing objects. 2024-09-11T08:20:47.306 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 0... 2024-09-11T08:20:47.306 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 25... 2024-09-11T08:20:47.306 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 50... 2024-09-11T08:20:47.306 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 75... 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 100... 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: listed object 125... 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: saw 150 objects 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_15_[82021]: shutting down. 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: starting. 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: added 25 objects... 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: added half of the objects 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: added 50 objects... 2024-09-11T08:20:47.307 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: added 50 objects 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: process_16_[82022]: shutting down. 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******************************* 2024-09-11T08:20:47.308 INFO:tasks.workunit.client.0.smithi173.stdout: list_parallel: ******* SUCCESS ********** 2024-09-11T08:20:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: pgmap v73: 900 pgs: 166 creating+peering, 602 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: osdmap e69: 8 total, 8 up, 8 in 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2550078213' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:47.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: pgmap v73: 900 pgs: 166 creating+peering, 602 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:47.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: osdmap e69: 8 total, 8 up, 8 in 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2550078213' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:47.541 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.542 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: pgmap v73: 900 pgs: 166 creating+peering, 602 unknown, 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:20:47.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:47.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:47.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: osdmap e69: 8 total, 8 up, 8 in 2024-09-11T08:20:47.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2550078213' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:47.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:47.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:47] "GET /metrics HTTP/1.1" 200 219768 "" "Prometheus/2.43.0" 2024-09-11T08:20:48.295 INFO:tasks.workunit.client.0.smithi173.stdout:sd pool application enable","pool": "LibRadosSnapshots_smithi173-80687-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.134127+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.157044+0000 mon.c [INF] from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:45.168121+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.445269+0000 mon.c [INF] from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.513419+0000 mon.b [INF] from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.517042+0000 mon.b [INF] from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.519375+0000 mon.b [INF] from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.524724+0000 mon.b [INF] from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.530654+0000 mon.c [INF] from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.718015+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.296 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.718307+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.718663+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.719328+0000 mon.c [INF] from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.719798+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.525259+0000 client.admin [INF] onexx 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.720599+0000 mon.c [INF] from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.967750+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.967944+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.297 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.968193+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.968941+0000 mon.b [INF] from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:46.969271+0000 mon.b [INF] from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.267787+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.268032+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.268389+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.268589+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.288737+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.289105+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.289220+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.289556+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.292587+0000 mon.c [INF] from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.298 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.298767+0000 mon.b [INF] from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: onexx 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: pgmap v76: 580 pgs: 32 creating+peering, 96 unknown, 452 active+clean; 588 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 30 KiB/s wr, 102 op/s 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3089164455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2308661013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:48.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: osdmap e70: 8 total, 8 up, 8 in 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: onexx 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: pgmap v76: 580 pgs: 32 creating+peering, 96 unknown, 452 active+clean; 588 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 30 KiB/s wr, 102 op/s 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: onexx 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: pgmap v76: 580 pgs: 32 creating+peering, 96 unknown, 452 active+clean; 588 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 30 KiB/s wr, 102 op/s 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi173-80879-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi173-80373-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3089164455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2308661013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:48.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: osdmap e70: 8 total, 8 up, 8 in 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3089164455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2308661013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:48.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: osdmap e70: 8 total, 8 up, 8 in 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:48.723 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.0 deep-scrub starts 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.0 deep-scrub ok 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.2 deep-scrub starts 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.2 deep-scrub ok 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: twoxx 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2375048831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.1 deep-scrub starts 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: 14.1 deep-scrub ok 2024-09-11T08:20:49.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: osdmap e71: 8 total, 8 up, 8 in 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.0 deep-scrub starts 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.0 deep-scrub ok 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.2 deep-scrub starts 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.2 deep-scrub ok 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: twoxx 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2375048831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.1 deep-scrub starts 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: 14.1 deep-scrub ok 2024-09-11T08:20:49.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: osdmap e71: 8 total, 8 up, 8 in 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:49.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.0 deep-scrub starts 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.0 deep-scrub ok 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.2 deep-scrub starts 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.2 deep-scrub ok 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: twoxx 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2375048831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.1 deep-scrub starts 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: 14.1 deep-scrub ok 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: osdmap e71: 8 total, 8 up, 8 in 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.721 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-09-11T08:20:49.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: pgmap v79: 780 pgs: 32 creating+peering, 328 unknown, 420 active+clean; 586 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 113 op/s 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: osdmap e72: 8 total, 8 up, 8 in 2024-09-11T08:20:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:50.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: pgmap v79: 780 pgs: 32 creating+peering, 328 unknown, 420 active+clean; 586 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 113 op/s 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: osdmap e72: 8 total, 8 up, 8 in 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:50.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:50.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: pgmap v79: 780 pgs: 32 creating+peering, 328 unknown, 420 active+clean; 586 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 17 KiB/s wr, 113 op/s 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: osdmap e72: 8 total, 8 up, 8 in 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:50.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:50.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:50.722 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:20:51.056 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.299222+0000 mon.b [INF] from='client.? 172.21.15.173:0/3089164455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test- open_pools_parallel: process_1_[81200]: starting. 2024-09-11T08:20:51.056 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: creating pool ceph_test_rados_open_pools_parallel.smithi173-81166 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: created object 0... 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: created object 25... 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: created object 49... 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: finishing. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_1_[81200]: shutting down. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_2_[81201]: starting. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_2_[81201]: rados_pool_create. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_2_[81201]: rados_ioctx_create. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_2_[81201]: shutting down. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: ******************************* 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: starting. 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: creating pool ceph_test_rados_open_pools_parallel.smithi173-81166 2024-09-11T08:20:51.057 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: created object 0... 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: created object 25... 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: created object 49... 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: finishing. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_3_[82096]: shutting down. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: ******************************* 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_4_[82097]: starting. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_4_[82097]: rados_pool_create. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_4_[82097]: rados_ioctx_create. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: process_4_[82097]: shutting down. 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: ******************************* 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: ******************************* 2024-09-11T08:20:51.058 INFO:tasks.workunit.client.0.smithi173.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: starting. 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: creating pool ceph_test_rados_delete_pools_parallel.smithi173-81167 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: created object 0... 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: created object 25... 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: created object 49... 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: finishing. 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_1_[81198]: shutting down. 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_2_[81199]: starting. 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_2_[81199]: deleting pool ceph_test_rados_delete_pools_parallel.smithi173-81167 2024-09-11T08:20:51.059 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_2_[81199]: shutting down. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******************************* 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: starting. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: creating pool ceph_test_rados_delete_pools_parallel.smithi173-81167 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: created object 0... 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: created object 25... 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: created object 49... 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: finishing. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_3_[82091]: shutting down. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******************************* 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: starting. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: listing objects. 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: listed object 0... 2024-09-11T08:20:51.060 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: listed object 25... 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: saw 50 objects 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_5_[82093]: shutting down. 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******************************* 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_4_[82092]: starting. 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_4_[82092]: deleting pool ceph_test_rados_delete_pools_parallel.smithi173-81167 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: process_4_[82092]: shutting down. 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******************************* 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******************************* 2024-09-11T08:20:51.061 INFO:tasks.workunit.client.0.smithi173.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-09-11T08:20:51.303 INFO:tasks.workunit.client.0.smithi173.stdout:rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.303 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.301767+0000 mon.c [INF] from='client.? 172.21.15.173:0/2308661013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.677148+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.677736+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.678173+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.678571+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.678975+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.679347+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.679723+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.680125+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.680505+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.680906+0000 mon.c [INF] from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.815221+0000 mon.b [INF] from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.815436+0000 mon.b [INF] from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:51.304 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.815928+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:47.816894+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.302969+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.315662+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi173-80373-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.315804+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.315884+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi173-80342-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.315982+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.316088+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi173-80353-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.316295+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi173-80812-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.316379+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.316604+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.317551+0000 mon.b [INF] from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.318084+0000 mon.b [INF] from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:51.305 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.318265+0000 mon.b [INF] from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:51.306 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.319740+0000 mon.c [INF] from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.306 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.320732+0000 mon.c [INF] from='client.? 172.21.15.173:0/398739025' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:51.306 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.322910+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:51.539 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.323549+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.323969+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.324146+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.324366+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.325237+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.369283+0000 mon.a [INF] from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.374202+0000 mon.a [INF] from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.376372+0000 mon.a [INF] from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.378099+0000 mon.a [INF] from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.386546+0000 mon.a [INF] from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.646866+0000 mon.a [INF] from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:49.749579+0000 mon.a [INF] from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:20:51.540 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:50.818586+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:51.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:50.818652+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:51.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:50.819123+0000 mon.c [INF] from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.050786+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-11T08:20:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: 14.3 deep-scrub starts 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: 14.3 deep-scrub ok 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: osdmap e73: 8 total, 8 up, 8 in 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:51.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: 14.3 deep-scrub starts 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: 14.3 deep-scrub ok 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: osdmap e73: 8 total, 8 up, 8 in 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: 14.3 deep-scrub starts 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: 14.3 deep-scrub ok 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1755128596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi173-80353-3", "field": "max_bytes", "val": "4096"}]': finished 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: osdmap e73: 8 total, 8 up, 8 in 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:51.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.050984+0000 mon.a [INF] from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi173-80428-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:52.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.051156+0000 mon.a [INF] from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:52.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.053295+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:52.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.053482+0000 mon.a [INF] from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:52.541 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.053949+0000 mon.a [INF] from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.296836+0000 mon.a [INF] from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.297040+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]: dispatch 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.303931+0000 mon.b [INF] from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.304085+0000 client.admin [INF] threexx 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.536967+0000 mon.a [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.545288+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.549235+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.549315+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.549378+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:52.542 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.549474+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:51.552783+0000 mon.c [INF] from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: d api_io_pp: Running main() from gmock_main.cc 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] Global test environment set-up. 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: seed 80392 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-09-11T08:20:52.632 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (266 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (14 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (4 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (5 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3 ms) 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-11T08:20:52.633 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (4 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (4 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (5 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (4 ms) 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-11T08:20:52.634 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (6 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (13 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (5 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (4 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (2 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (3 ms) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (361 ms total) 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-11T08:20:52.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1056 ms) 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (11 ms) 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (3 ms) 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (5 ms) 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-11T08:20:52.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (2 ms) 2024-09-11T08:20:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: pgmap v82: 524 pgs: 16 creating+peering, 16 unknown, 492 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 403 op/s 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: 14.6 deep-scrub starts 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: 14.6 deep-scrub ok 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: 14.7 deep-scrub starts 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: 14.7 deep-scrub ok 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: threexx 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4022126147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: osdmap e74: 8 total, 8 up, 8 in 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: pgmap v82: 524 pgs: 16 creating+peering, 16 unknown, 492 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 403 op/s 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: 14.6 deep-scrub starts 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: 14.6 deep-scrub ok 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: 14.7 deep-scrub starts 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: 14.7 deep-scrub ok 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: threexx 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4022126147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: osdmap e74: 8 total, 8 up, 8 in 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: pgmap v82: 524 pgs: 16 creating+peering, 16 unknown, 492 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 403 op/s 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: 14.6 deep-scrub starts 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: 14.6 deep-scrub ok 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: 14.7 deep-scrub starts 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: 14.7 deep-scrub ok 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: threexx 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi173-80812-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi173-80392-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi173-80768-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-4", "overlaypool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:52.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4022126147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: osdmap e74: 8 total, 8 up, 8 in 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:52.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.8 deep-scrub starts 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.8 deep-scrub ok 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.9 deep-scrub starts 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.9 deep-scrub ok 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.4 deep-scrub starts 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: 14.4 deep-scrub ok 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: fourxx 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: osdmap e75: 8 total, 8 up, 8 in 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/362179039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: pgmap v85: 684 pgs: 16 creating+peering, 184 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 436 op/s 2024-09-11T08:20:53.598 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] api_io: Running main() from gmock_main.cc 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] Global test environment set-up. 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (210 ms) 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-09-11T08:20:53.599 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: no timeout :/ 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: no timeout :/ 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: no timeout :/ 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: no timeout :/ 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: no timeout :/ 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (435 ms) 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (7 ms) 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-09-11T08:20:53.600 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.Checksum (3 ms) 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (4 ms) 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3 ms) 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (4 ms) 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-09-11T08:20:53.601 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.TruncTest (6 ms) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (5 ms) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (4 ms) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.RmXattr (14 ms) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIo.XattrIter (6 ms) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] 14 tests from LibRadosIo (703 ms total) 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: 2024-09-11T08:20:53.602 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1067 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (6 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (5 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (5 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (6 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (3 ms) 2024-09-11T08:20:53.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (7 ms) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (4 ms) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1109 ms total) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [----------] Global test environment tear-down 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [==========] 24 tests from 2 test suites ran. (15264 ms total) 2024-09-11T08:20:53.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_io: [ PASSED ] 24 tests. 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.8 deep-scrub starts 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.8 deep-scrub ok 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.9 deep-scrub starts 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.9 deep-scrub ok 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.4 deep-scrub starts 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: 14.4 deep-scrub ok 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: fourxx 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: osdmap e75: 8 total, 8 up, 8 in 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/362179039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.8 deep-scrub starts 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.8 deep-scrub ok 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.9 deep-scrub starts 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.9 deep-scrub ok 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.4 deep-scrub starts 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: 14.4 deep-scrub ok 2024-09-11T08:20:53.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1466102512' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: fourxx 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi173-80428-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi173-80458-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: osdmap e75: 8 total, 8 up, 8 in 2024-09-11T08:20:53.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/362179039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4285993530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.971 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: pgmap v85: 684 pgs: 16 creating+peering, 184 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 436 op/s 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:53.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: pgmap v85: 684 pgs: 16 creating+peering, 184 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 436 op/s 2024-09-11T08:20:53.973 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: osdmap e76: 8 total, 8 up, 8 in 2024-09-11T08:20:54.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:20:54.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]': finished 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: osdmap e77: 8 total, 8 up, 8 in 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3077128809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/709316322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-11T08:20:54.847 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.848 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: osdmap e76: 8 total, 8 up, 8 in 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2"}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi173-80342-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi173-80373-16"}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-4"}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: osdmap e76: 8 total, 8 up, 8 in 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]: dispatch 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]: dispatch 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]': finished 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: osdmap e77: 8 total, 8 up, 8 in 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3077128809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/709316322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-4", "tierpool": "test-rados-api-smithi173-80673-4-cache"}]': finished 2024-09-11T08:20:54.972 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pg_num": 4}]': finished 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: osdmap e77: 8 total, 8 up, 8 in 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2467066526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3280149232' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4131362576' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3077128809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/709316322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-09-11T08:20:54.973 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]: dispatch 2024-09-11T08:20:54.974 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (3 ms) 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (5 ms) 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (6 ms) 2024-09-11T08:20:55.342 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (2 ms) 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (7 ms) 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (3 ms) 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-11T08:20:55.343 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (9 ms) 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (4 ms) 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (5 ms) 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1133 ms total) 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [----------] Global test environment tear-down 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (17004 ms total) 2024-09-11T08:20:55.344 INFO:tasks.workunit.client.0.smithi173.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-09-11T08:20:55.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:20:55.345 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: Running main() from gmock_main.cc 2024-09-11T08:20:55.345 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] Global test environment set-up. 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] 4 tests from LibRadosStat 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStat.Stat (208 ms) 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStat.StatNS (60 ms) 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (75 ms) 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (286 ms) 2024-09-11T08:20:55.346 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] 4 tests from LibRadosStat (629 ms total) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1052 ms) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (10 ms) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1064 ms total) 2024-09-11T08:20:55.347 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [----------] Global test environment tear-down 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (16867 ms total) 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat: [ PASSED ] 8 tests. 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-09-11T08:20:55.348 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: seed 80768 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (242 ms) 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (6 ms) 2024-09-11T08:20:55.349 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (7 ms) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (15 ms) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (270 ms total) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1051 ms) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-11T08:20:55.350 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (5 ms) 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (7 ms) 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1064 ms total) 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (16876 ms total) 2024-09-11T08:20:55.351 INFO:tasks.workunit.client.0.smithi173.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-09-11T08:20:55.547 INFO:tasks.workunit.client.0.smithi173.stdout:ispatch 2024-09-11T08:20:55.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.028784+0000 mon.a [INF] from='client.? 172.21.15.173:0/1288725760' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.028890+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi173-80879-1"}]': finished 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.029666+0000 mon.c [INF] from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.029938+0000 mon.c [INF] from='client.? 172.21.15.173:0/4022126147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.269888+0000 mon.a [INF] from='client.? 172.21.15.173:0/2313900800' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-4-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.270437+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi173-80373-16"}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.270878+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi173-80550-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: got: 2024-09-11T08:20:52.271257+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9082 ms) 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (17061 ms total) 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [----------] Global test environment tear-down 2024-09-11T08:20:55.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (17061 ms total) 2024-09-11T08:20:55.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_cmd: [ PASSED ] 4 tests. 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: 14.5 deep-scrub starts 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: 14.5 deep-scrub ok 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: pgmap v88: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: osdmap e78: 8 total, 8 up, 8 in 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: 14.5 deep-scrub starts 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: 14.5 deep-scrub ok 2024-09-11T08:20:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: pgmap v88: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: osdmap e78: 8 total, 8 up, 8 in 2024-09-11T08:20:55.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:55.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:55.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:55.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:56.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:20:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: 14.5 deep-scrub starts 2024-09-11T08:20:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: 14.5 deep-scrub ok 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: pgmap v88: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi173-80392-22"}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi173-80768-7"}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi173-80812-6"}]': finished 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: osdmap e78: 8 total, 8 up, 8 in 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:56.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:20:56.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:56.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: osdmap e79: 8 total, 8 up, 8 in 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:56.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3413927289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: osdmap e79: 8 total, 8 up, 8 in 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:56.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3413927289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:56.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: osdmap e79: 8 total, 8 up, 8 in 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/811745783' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3413927289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:20:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:57.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:57.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:57.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:57.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:20:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:20:57] "GET /metrics HTTP/1.1" 200 260595 "" "Prometheus/2.43.0" 2024-09-11T08:20:58.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: pgmap v91: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.7 KiB/s wr, 4 op/s 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: osdmap e80: 8 total, 8 up, 8 in 2024-09-11T08:20:58.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1547586879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1863767376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.347 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:58.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: pgmap v91: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.7 KiB/s wr, 4 op/s 2024-09-11T08:20:58.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]': finished 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:58.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:58.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: osdmap e80: 8 total, 8 up, 8 in 2024-09-11T08:20:58.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:58.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1547586879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:58.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1863767376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.471 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:20:58.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:58.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: pgmap v91: 488 pgs: 32 unknown, 456 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.7 KiB/s wr, 4 op/s 2024-09-11T08:20:58.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:20:58.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:58.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:58.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "mode": "writeback"}]': finished 2024-09-11T08:20:58.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi173-80550-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:20:58.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi173-80342-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: osdmap e80: 8 total, 8 up, 8 in 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]: dispatch 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1547586879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]: dispatch 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:20:58.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1863767376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: seed 80458 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (271 ms) 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (5 ms) 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-11T08:20:58.743 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1010 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1039 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (4 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3 ms) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2340 ms total) 2024-09-11T08:20:58.744 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1066 ms) 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (11 ms) 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1004 ms) 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1004 ms) 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T08:20:58.745 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (5 ms) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (4 ms) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (4 ms) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3102 ms total) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (20374 ms total) 2024-09-11T08:20:58.746 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: Running main() from gmock_main.cc 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] Global test environment set-up. 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (255 ms) 2024-09-11T08:20:58.747 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.LockShared (6 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1007 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1038 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (4 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.Unlock (3 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (4 ms) 2024-09-11T08:20:58.748 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (2 ms) 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] 8 tests from LibRadosLock (2319 ms total) 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1091 ms) 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (3 ms) 2024-09-11T08:20:58.749 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1003 ms) 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1004 ms) 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (3 ms) 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (3 ms) 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (5 ms) 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-09-11T08:20:58.750 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2 ms) 2024-09-11T08:20:58.751 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3114 ms total) 2024-09-11T08:20:58.751 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: 2024-09-11T08:20:58.751 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [----------] Global test environment tear-down 2024-09-11T08:20:58.751 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (20387 ms total) 2024-09-11T08:20:58.751 INFO:tasks.workunit.client.0.smithi173.stdout: api_lock: [ PASSED ] 16 tests. 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: osdmap e81: 8 total, 8 up, 8 in 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1095164269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: osdmap e81: 8 total, 8 up, 8 in 2024-09-11T08:20:59.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1095164269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.721 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:20:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:20:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3707280350' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi173-80458-10"}]': finished 2024-09-11T08:20:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/183931899' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi173-80428-10"}]': finished 2024-09-11T08:20:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: osdmap e81: 8 total, 8 up, 8 in 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1095164269' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:20:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:20:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.560 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1054 ms) 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (4 ms) 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1058 ms total) 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-11T08:21:00.561 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (76 ms) 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3785 ms) 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (6 ms) 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (11 ms) 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554939536 notify_id 343597383682 notifier_gid 25094 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (20 ms) 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554939536 notify_id 343597383683 notifier_gid 25094 2024-09-11T08:21:00.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (12 ms) 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554965232 notify_id 343597383681 notifier_gid 25094 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (24 ms) 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 343597383684 notifier_gid 25094 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (19 ms) 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 343597383685 notifier_gid 25094 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (9 ms) 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 343597383686 notifier_gid 25094 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (16 ms) 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-11T08:21:00.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: trying... 2024-09-11T08:21:00.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 343597383681 notifier_gid 25094 2024-09-11T08:21:00.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: timed out 2024-09-11T08:21:00.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: flushing 2024-09-11T08:21:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: pgmap v94: 488 pgs: 128 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:21:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:21:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: pool 'PoolQuotaPP_smithi173-80353-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-11T08:21:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: osdmap e82: 8 total, 8 up, 8 in 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4037894328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1888403419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: pgmap v94: 488 pgs: 128 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: pool 'PoolQuotaPP_smithi173-80353-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: osdmap e82: 8 total, 8 up, 8 in 2024-09-11T08:21:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4037894328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1888403419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: pgmap v94: 488 pgs: 128 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: pool 'PoolQuotaPP_smithi173-80353-3' is full (reached quota's max_bytes: 4 KiB) 2024-09-11T08:21:00.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi173-80748-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi173-80687-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: osdmap e82: 8 total, 8 up, 8 in 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4037894328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1888403419' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:00.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:21:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:21:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: osdmap e83: 8 total, 8 up, 8 in 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1102692097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3937795666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: pgmap v97: 592 pgs: 232 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:01.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:01.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:01.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: osdmap e83: 8 total, 8 up, 8 in 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1102692097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3937795666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: pgmap v97: 592 pgs: 232 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi173-80342-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi173-80733-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:01.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: osdmap e83: 8 total, 8 up, 8 in 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1102692097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3937795666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: pgmap v97: 592 pgs: 232 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:01.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-11T08:21:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: osdmap e84: 8 total, 8 up, 8 in 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: osdmap e84: 8 total, 8 up, 8 in 2024-09-11T08:21:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: osdmap e84: 8 total, 8 up, 8 in 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:02.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:02.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:03.635 INFO:tasks.workunit.client.0.smithi173.stdout: api api_watch_notify: Running main() from gmock_main.cc 2024-09-11T08:21:03.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-09-11T08:21:03.635 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify_test_cb 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (221 ms) 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94429323011104 err -107 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (26 ms) 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-11T08:21:03.636 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94429323022960 err -107 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1017 ms) 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743425 cookie 94429323025168 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (5 ms) 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743424 cookie 94429323051696 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (4 ms) 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-09-11T08:21:03.637 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743424 cookie 94429323051696 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (4 ms) 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743425 cookie 94429323079888 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743425 cookie 94429323090304 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (6 ms) 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 296352743424 cookie 94429323090304 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 300647710721 cookie 94429323090304 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3018 ms) 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94429323090304 err -107 2024-09-11T08:21:03.638 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_cb from 24730 notify_id 330712481794 cookie 94429323090304 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5006 ms) 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94429323090304 err -107 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1004 ms) 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (10311 ms total) 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: watch_notify_test_cb 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1121 ms) 2024-09-11T08:21:03.639 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1121 ms total) 2024-09-11T08:21:03.640 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: 2024-09-11T08:21:03.640 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-09-11T08:21:03.640 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (25171 ms total) 2024-09-11T08:21:03.640 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-09-11T08:21:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: osdmap e85: 8 total, 8 up, 8 in 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: pgmap v100: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1386212509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: osdmap e85: 8 total, 8 up, 8 in 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: pgmap v100: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-09-11T08:21:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1386212509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: osdmap e85: 8 total, 8 up, 8 in 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: pgmap v100: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.3 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-09-11T08:21:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1386212509' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3623228916' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:03.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]: dispatch 2024-09-11T08:21:03.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: osdmap e86: 8 total, 8 up, 8 in 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: osdmap e87: 8 total, 8 up, 8 in 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:04.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: osdmap e86: 8 total, 8 up, 8 in 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:04.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: osdmap e87: 8 total, 8 up, 8 in 2024-09-11T08:21:04.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:04.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi173-80342-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi173-80748-12"}]': finished 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: osdmap e86: 8 total, 8 up, 8 in 2024-09-11T08:21:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/433721131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-81086-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: osdmap e87: 8 total, 8 up, 8 in 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]: dispatch 2024-09-11T08:21:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:05.622 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (7889 ms) 2024-09-11T08:21:05.623 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (2870 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (4241 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (2783 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3144 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3087 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3041 ms) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (27055 ms total) 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: 2024-09-11T08:21:05.624 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-09-11T08:21:05.625 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (27055 ms total) 2024-09-11T08:21:05.625 INFO:tasks.workunit.client.0.smithi173.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: pgmap v103: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 KiB/s wr, 7 op/s 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: osdmap e88: 8 total, 8 up, 8 in 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1402220644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/242784733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: pgmap v103: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 KiB/s wr, 7 op/s 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: osdmap e88: 8 total, 8 up, 8 in 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1402220644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/242784733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:05.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:06.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: pgmap v103: 520 pgs: 32 unknown, 42 creating+peering, 446 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.0 KiB/s wr, 7 op/s 2024-09-11T08:21:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-7"}]': finished 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: osdmap e88: 8 total, 8 up, 8 in 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1402220644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/242784733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [----------] Global test environment set-up. 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [----------] 4 tests from LibRadosService 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5039 ms) 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ OK ] LibRadosService.RegisterLate (14 ms) 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: cluster: 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: id: 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:21:06.651 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: health: HEALTH_WARN 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 8 pool(s) do not have an application enabled 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: services: 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: data: 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: pools: 14 pools, 388 pgs 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: objects: 196 objects, 582 KiB 2024-09-11T08:21:06.652 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: pgs: 23.196% pgs unknown 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 42.784% pgs not active 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 166 creating+peering 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 132 active+clean 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 90 unknown 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: io: 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: cluster: 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: id: 4492cbfa-7015-11ef-bcea-c7b262605968 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: health: HEALTH_WARN 2024-09-11T08:21:06.653 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 23 pool(s) do not have an application enabled 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: services: 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: data: 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: pools: 30 pools, 900 pgs 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: objects: 196 objects, 582 KiB 2024-09-11T08:21:06.654 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: pgs: 66.889% pgs unknown 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 18.444% pgs not active 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 602 unknown 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 166 creating+peering 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 132 active+clean 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: io: 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2943 ms) 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ RUN ] LibRadosService.Status 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ OK ] LibRadosService.Status (20097 ms) 2024-09-11T08:21:06.655 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [----------] 4 tests from LibRadosService (28093 ms total) 2024-09-11T08:21:06.656 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: 2024-09-11T08:21:06.656 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [----------] Global test environment tear-down 2024-09-11T08:21:06.656 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [==========] 4 tests from 1 test suite ran. (28093 ms total) 2024-09-11T08:21:06.656 INFO:tasks.workunit.client.0.smithi173.stdout: api_service: [ PASSED ] 4 tests. 2024-09-11T08:21:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[29664]: osdmap e89: 8 total, 8 up, 8 in 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:07] "GET /metrics HTTP/1.1" 200 252044 "" "Prometheus/2.43.0" 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:07 smithi173 ceph-mon[40835]: osdmap e89: 8 total, 8 up, 8 in 2024-09-11T08:21:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi173-80342-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:07 smithi175 ceph-mon[32813]: osdmap e89: 8 total, 8 up, 8 in 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: pgmap v106: 456 pgs: 64 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: osdmap e90: 8 total, 8 up, 8 in 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/808442009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: pgmap v106: 456 pgs: 64 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: osdmap e90: 8 total, 8 up, 8 in 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/808442009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:08.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: pgmap v106: 456 pgs: 64 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: osdmap e90: 8 total, 8 up, 8 in 2024-09-11T08:21:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/808442009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:09.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:09.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:09.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:09.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-09-11T08:21:09.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [----------] Global test environment set-up. 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5064 ms) 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (528 ms) 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20281 ms) 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: attempt 0 of 20 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5124 ms) 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30997 ms total) 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: 2024-09-11T08:21:09.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [----------] Global test environment tear-down 2024-09-11T08:21:09.558 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30997 ms total) 2024-09-11T08:21:09.558 INFO:tasks.workunit.client.0.smithi173.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: pgmap v108: 520 pgs: 96 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: osdmap e91: 8 total, 8 up, 8 in 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3715096338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.468 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: osdmap e92: 8 total, 8 up, 8 in 2024-09-11T08:21:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3266908741' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: pgmap v108: 520 pgs: 96 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: osdmap e91: 8 total, 8 up, 8 in 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3715096338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:10.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: osdmap e92: 8 total, 8 up, 8 in 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3266908741' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: pgmap v108: 520 pgs: 96 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:21:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: osdmap e91: 8 total, 8 up, 8 in 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3715096338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi173-80342-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: osdmap e92: 8 total, 8 up, 8 in 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:10.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3266908741' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]': finished 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: osdmap e93: 8 total, 8 up, 8 in 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/57945502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]': finished 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: osdmap e93: 8 total, 8 up, 8 in 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/57945502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4"}]': finished 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: osdmap e93: 8 total, 8 up, 8 in 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/57945502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:11.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: pgmap v112: 456 pgs: 96 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]': finished 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: osdmap e94: 8 total, 8 up, 8 in 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1817311039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: pgmap v112: 456 pgs: 96 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]': finished 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: osdmap e94: 8 total, 8 up, 8 in 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1817311039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: pgmap v112: 456 pgs: 96 unknown, 360 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi173-80687-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:12.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6"}]': finished 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-9", "mode": "writeback"}]': finished 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2513267933' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi173-80353-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: osdmap e94: 8 total, 8 up, 8 in 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3438010973' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1817311039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:12.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:13.493 INFO:tasks.workunit.client.0.smithi173.stdout:_watch_notify_pp: flushed 2024-09-11T08:21:13.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3008 ms) 2024-09-11T08:21:13.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-11T08:21:13.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: trying... 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 356482285575 notifier_gid 25094 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: timed out 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: flushing 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: flushed 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3063 ms) 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: List watches 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify2 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 369367187459 notifier_gid 25094 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify2 done 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: watch_check 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: unwatch2 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: flushing 2024-09-11T08:21:13.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: done 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3039 ms) 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: List watches 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify2 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: handle_notify cookie 94910554967760 notify_id 382252089352 notifier_gid 25094 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: notify2 done 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: watch_check 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: unwatch2 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: flushing 2024-09-11T08:21:13.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: done 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3044 ms) 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16132 ms total) 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (34983 ms total) 2024-09-11T08:21:13.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-09-11T08:21:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:21:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:13.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: osdmap e95: 8 total, 8 up, 8 in 2024-09-11T08:21:13.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:13.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: osdmap e95: 8 total, 8 up, 8 in 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:13.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:13.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi173-80879-6", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi173-80342-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: osdmap e95: 8 total, 8 up, 8 in 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:13.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]: dispatch 2024-09-11T08:21:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: pgmap v115: 492 pgs: 15 creating+peering, 89 unknown, 388 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2024-09-11T08:21:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: osdmap e96: 8 total, 8 up, 8 in 2024-09-11T08:21:14.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:14.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: pgmap v115: 492 pgs: 15 creating+peering, 89 unknown, 388 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2024-09-11T08:21:14.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:14.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:14.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: osdmap e96: 8 total, 8 up, 8 in 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: pgmap v115: 492 pgs: 15 creating+peering, 89 unknown, 388 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-9"}]': finished 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: osdmap e96: 8 total, 8 up, 8 in 2024-09-11T08:21:14.620 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:15.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: osdmap e97: 8 total, 8 up, 8 in 2024-09-11T08:21:15.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4019621595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: osdmap e97: 8 total, 8 up, 8 in 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4019621595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.636 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2631978381' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi173-80353-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: osdmap e97: 8 total, 8 up, 8 in 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4019621595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:15.637 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.236 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:16.405 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: pgmap v118: 396 pgs: 72 unknown, 324 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:16.405 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:16.405 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:16.405 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: osdmap e98: 8 total, 8 up, 8 in 2024-09-11T08:21:16.405 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: pgmap v118: 396 pgs: 72 unknown, 324 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: osdmap e98: 8 total, 8 up, 8 in 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: pgmap v118: 396 pgs: 72 unknown, 324 active+clean; 145 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi173-80342-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: osdmap e98: 8 total, 8 up, 8 in 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:16.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.490 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-09-11T08:21:17.490 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] Global test environment set-up. 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:20:38.473+0000 7f889aedb600 -1 failed for service _ceph-mon._tcp 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:20:38.473+0000 7f889aedb600 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (71 ms) 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5016 ms) 2024-09-11T08:21:17.491 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5087 ms total) 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: started 0x55aa8e5f82d0 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: started 0x55aa8e5fcad0 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: started 2 aios 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: waiting 0x55aa8e5f82d0 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: waiting 0x55aa8e5fcad0 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: done. 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (7091 ms) 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (7091 ms total) 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-09-11T08:21:17.492 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.Exec (48 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (7 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (3 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4729 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-09-11T08:21:17.493 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (19177 ms) 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] 8 tests from LibRadosMisc (23965 ms total) 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [----------] Global test environment tear-down 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (39073 ms total) 2024-09-11T08:21:17.494 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc: [ PASSED ] 12 tests. 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: osdmap e99: 8 total, 8 up, 8 in 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2973206906' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: osdmap e99: 8 total, 8 up, 8 in 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2973206906' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:17.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:17.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80666-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:17.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: osdmap e99: 8 total, 8 up, 8 in 2024-09-11T08:21:17.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2973206906' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:17] "GET /metrics HTTP/1.1" 200 252044 "" "Prometheus/2.43.0" 2024-09-11T08:21:18.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: pgmap v121: 428 pgs: 64 creating+peering, 32 unknown, 332 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-11T08:21:18.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: osdmap e100: 8 total, 8 up, 8 in 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3996636779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:18.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:18.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:18.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:18.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:18.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:18.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: pgmap v121: 428 pgs: 64 creating+peering, 32 unknown, 332 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: osdmap e100: 8 total, 8 up, 8 in 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3996636779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:18.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: pgmap v121: 428 pgs: 64 creating+peering, 32 unknown, 332 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi173-80353-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: osdmap e100: 8 total, 8 up, 8 in 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3996636779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:18.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:18.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:18.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:18.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:18.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:18.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:19.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:19.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: 14.7 deep-scrub starts 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: 14.7 deep-scrub ok 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]': finished 2024-09-11T08:21:19.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: osdmap e101: 8 total, 8 up, 8 in 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: 14.7 deep-scrub starts 2024-09-11T08:21:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: 14.7 deep-scrub ok 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]': finished 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: osdmap e101: 8 total, 8 up, 8 in 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:19.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: 14.7 deep-scrub starts 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: 14.7 deep-scrub ok 2024-09-11T08:21:19.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache", "force_nonempty":""}]': finished 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi173-80342-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: osdmap e101: 8 total, 8 up, 8 in 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:19.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: pgmap v124: 428 pgs: 64 creating+peering, 64 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 3 op/s 2024-09-11T08:21:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: 14.2 deep-scrub starts 2024-09-11T08:21:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: 14.2 deep-scrub ok 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: osdmap e102: 8 total, 8 up, 8 in 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/837743480' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:20.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: pgmap v124: 428 pgs: 64 creating+peering, 64 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 3 op/s 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: 14.2 deep-scrub starts 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: 14.2 deep-scrub ok 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: osdmap e102: 8 total, 8 up, 8 in 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/837743480' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: pgmap v124: 428 pgs: 64 creating+peering, 64 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 257 KiB/s wr, 3 op/s 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: 14.2 deep-scrub starts 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: 14.2 deep-scrub ok 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80666-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: osdmap e102: 8 total, 8 up, 8 in 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/837743480' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/263761055' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]: dispatch 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.9 deep-scrub starts 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.9 deep-scrub ok 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.0 deep-scrub starts 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.0 deep-scrub ok 2024-09-11T08:21:21.495 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.1 deep-scrub starts 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.4 deep-scrub starts 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.1 deep-scrub ok 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: 14.4 deep-scrub ok 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]': finished 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]': finished 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: osdmap e103: 8 total, 8 up, 8 in 2024-09-11T08:21:21.496 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.9 deep-scrub starts 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.9 deep-scrub ok 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.0 deep-scrub starts 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.0 deep-scrub ok 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.1 deep-scrub starts 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.4 deep-scrub starts 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.1 deep-scrub ok 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: 14.4 deep-scrub ok 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]': finished 2024-09-11T08:21:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]': finished 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: osdmap e103: 8 total, 8 up, 8 in 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.9 deep-scrub starts 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.9 deep-scrub ok 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.0 deep-scrub starts 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.0 deep-scrub ok 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.1 deep-scrub starts 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.4 deep-scrub starts 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.1 deep-scrub ok 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: 14.4 deep-scrub ok 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:21.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi173-80353-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:21.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-11", "mode": "writeback"}]': finished 2024-09-11T08:21:21.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80666-10", "tierpool":"test-rados-api-smithi173-80666-10-cache"}]': finished 2024-09-11T08:21:21.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: osdmap e103: 8 total, 8 up, 8 in 2024-09-11T08:21:21.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: Running main() from gmock_main.cc 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [----------] Global test environment set-up. 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolList (7722 ms) 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4910 ms) 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2515 ms) 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-11T08:21:22.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (2783 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3149 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5100 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4864 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5008 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7993 ms) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [----------] 9 tests from LibRadosPools (44045 ms total) 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: 2024-09-11T08:21:22.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [----------] Global test environment tear-down 2024-09-11T08:21:22.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (44046 ms total) 2024-09-11T08:21:22.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_pool: [ PASSED ] 9 tests. 2024-09-11T08:21:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: pgmap v127: 460 pgs: 64 creating+peering, 96 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: osdmap e104: 8 total, 8 up, 8 in 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:22.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: pgmap v127: 460 pgs: 64 creating+peering, 96 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: osdmap e104: 8 total, 8 up, 8 in 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: pgmap v127: 460 pgs: 64 creating+peering, 96 unknown, 300 active+clean; 146 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1387372248' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi173-80342-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: osdmap e104: 8 total, 8 up, 8 in 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:22.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:22.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:21:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: osdmap e105: 8 total, 8 up, 8 in 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4050140009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: osdmap e105: 8 total, 8 up, 8 in 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4050140009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: osdmap e105: 8 total, 8 up, 8 in 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]: dispatch 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4050140009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3861002706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]: dispatch 2024-09-11T08:21:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: pgmap v130: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-09-11T08:21:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: osdmap e106: 8 total, 8 up, 8 in 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: pgmap v130: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-09-11T08:21:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: osdmap e106: 8 total, 8 up, 8 in 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: pgmap v130: 356 pgs: 32 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-09-11T08:21:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-11"}]': finished 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi173-80687-9"}]': finished 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: osdmap e106: 8 total, 8 up, 8 in 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:24.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-mon[32813]: osdmap e107: 8 total, 8 up, 8 in 2024-09-11T08:21:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[29664]: osdmap e107: 8 total, 8 up, 8 in 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3405094950' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi173-80342-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[40835]: osdmap e107: 8 total, 8 up, 8 in 2024-09-11T08:21:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:26.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: pgmap v133: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: osdmap e108: 8 total, 8 up, 8 in 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/757568277' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.713 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: pgmap v133: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-09-11T08:21:26.713 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:26.713 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:26.714 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: osdmap e108: 8 total, 8 up, 8 in 2024-09-11T08:21:26.714 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/757568277' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.714 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.714 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.714 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: pgmap v133: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: osdmap e108: 8 total, 8 up, 8 in 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/757568277' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.715 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:26.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: osdmap e109: 8 total, 8 up, 8 in 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3951366779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: osdmap e109: 8 total, 8 up, 8 in 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3951366779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi173-80687-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi173-80353-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: osdmap e109: 8 total, 8 up, 8 in 2024-09-11T08:21:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3951366779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:27] "GET /metrics HTTP/1.1" 200 244879 "" "Prometheus/2.43.0" 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: pgmap v136: 396 pgs: 40 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: 14.3 deep-scrub starts 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: 14.3 deep-scrub ok 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:28 smithi175 ceph-mon[32813]: osdmap e110: 8 total, 8 up, 8 in 2024-09-11T08:21:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: pgmap v136: 396 pgs: 40 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T08:21:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: 14.3 deep-scrub starts 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: 14.3 deep-scrub ok 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[29664]: osdmap e110: 8 total, 8 up, 8 in 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: pgmap v136: 396 pgs: 40 unknown, 64 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: 14.3 deep-scrub starts 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: 14.3 deep-scrub ok 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi173-80342-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:28 smithi173 ceph-mon[40835]: osdmap e110: 8 total, 8 up, 8 in 2024-09-11T08:21:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:29 smithi175 ceph-mon[32813]: osdmap e111: 8 total, 8 up, 8 in 2024-09-11T08:21:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2590162165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:29.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[40835]: osdmap e111: 8 total, 8 up, 8 in 2024-09-11T08:21:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2590162165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[29664]: osdmap e111: 8 total, 8 up, 8 in 2024-09-11T08:21:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2590162165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: pgmap v139: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:21:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: osdmap e112: 8 total, 8 up, 8 in 2024-09-11T08:21:30.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1823468394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: pgmap v139: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:21:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: osdmap e112: 8 total, 8 up, 8 in 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1823468394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: pgmap v139: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi173-80353-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: osdmap e112: 8 total, 8 up, 8 in 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1823468394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:31 smithi175 ceph-mon[32813]: osdmap e113: 8 total, 8 up, 8 in 2024-09-11T08:21:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:31.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[29664]: osdmap e113: 8 total, 8 up, 8 in 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi173-80342-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[40835]: osdmap e113: 8 total, 8 up, 8 in 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: pgmap v142: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: osdmap e114: 8 total, 8 up, 8 in 2024-09-11T08:21:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4115895160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:32.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: pgmap v142: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: osdmap e114: 8 total, 8 up, 8 in 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4115895160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: pgmap v142: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: osdmap e114: 8 total, 8 up, 8 in 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4115895160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:32.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: osdmap e115: 8 total, 8 up, 8 in 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: osdmap e115: 8 total, 8 up, 8 in 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi173-80353-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: osdmap e115: 8 total, 8 up, 8 in 2024-09-11T08:21:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]: dispatch 2024-09-11T08:21:33.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: pgmap v145: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]': finished 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: osdmap e116: 8 total, 8 up, 8 in 2024-09-11T08:21:34.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:34.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:34.597 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: pgmap v145: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]': finished 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: osdmap e116: 8 total, 8 up, 8 in 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:34.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: pgmap v145: 396 pgs: 64 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-13", "mode": "writeback"}]': finished 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3555455120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi173-80342-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: osdmap e116: 8 total, 8 up, 8 in 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:34.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:34.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:34.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:34.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:34.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:34.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: 93.0 scrub starts 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: 93.0 scrub ok 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: osdmap e117: 8 total, 8 up, 8 in 2024-09-11T08:21:35.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:35.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: 93.2 scrub starts 2024-09-11T08:21:35.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: 93.2 scrub ok 2024-09-11T08:21:35.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:35.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: 93.0 scrub starts 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: 93.0 scrub ok 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: osdmap e117: 8 total, 8 up, 8 in 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: 93.2 scrub starts 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: 93.2 scrub ok 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.0"}]: dispatch 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.1"}]: dispatch 2024-09-11T08:21:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.2"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.3"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.4"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.5"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.6"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.7"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.8"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "93.9"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: 93.0 scrub starts 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: 93.0 scrub ok 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: osdmap e117: 8 total, 8 up, 8 in 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: 93.2 scrub starts 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: 93.2 scrub ok 2024-09-11T08:21:35.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:21:35.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:36.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: pgmap v148: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: 14.6 deep-scrub starts 2024-09-11T08:21:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: 14.6 deep-scrub ok 2024-09-11T08:21:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:36.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: osdmap e118: 8 total, 8 up, 8 in 2024-09-11T08:21:36.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1283971566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: pgmap v148: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: 14.6 deep-scrub starts 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: 14.6 deep-scrub ok 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: osdmap e118: 8 total, 8 up, 8 in 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1283971566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: pgmap v148: 364 pgs: 32 unknown, 332 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 129 KiB/s wr, 127 op/s 2024-09-11T08:21:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: 14.6 deep-scrub starts 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: 14.6 deep-scrub ok 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2806133479' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi173-80353-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: osdmap e118: 8 total, 8 up, 8 in 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1283971566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:36.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:37.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: Running main() from gmock_main.cc 2024-09-11T08:21:37.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2024-09-11T08:21:37.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] Global test environment set-up. 2024-09-11T08:21:37.470 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2162 ms) 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (3753 ms) 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2518 ms) 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2766 ms) 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (11199 ms total) 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-11T08:21:37.471 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4138 ms) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4104 ms) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (8242 ms total) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3004 ms) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1987 ms) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2001 ms) 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T08:21:37.472 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1982 ms) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8974 ms total) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4026 ms) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3987 ms) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8013 ms total) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [----------] Global test environment tear-down 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (59038 ms total) 2024-09-11T08:21:37.473 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots: [ PASSED ] 12 tests. 2024-09-11T08:21:37.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: 93.4 scrub starts 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: 93.4 scrub ok 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: 93.6 scrub starts 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: 93.6 scrub ok 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:37.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:37.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: osdmap e119: 8 total, 8 up, 8 in 2024-09-11T08:21:37.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:37.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: 93.4 scrub starts 2024-09-11T08:21:37.538 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: 93.4 scrub ok 2024-09-11T08:21:37.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:37.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: 93.6 scrub starts 2024-09-11T08:21:37.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: 93.6 scrub ok 2024-09-11T08:21:37.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:37.539 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:37.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:37.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: osdmap e119: 8 total, 8 up, 8 in 2024-09-11T08:21:37.540 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: 93.4 scrub starts 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: 93.4 scrub ok 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: 93.6 scrub starts 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: 93.6 scrub ok 2024-09-11T08:21:37.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:37.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi173-80342-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:37.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:37.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: osdmap e119: 8 total, 8 up, 8 in 2024-09-11T08:21:37.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]: dispatch 2024-09-11T08:21:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:37] "GET /metrics HTTP/1.1" 200 240291 "" "Prometheus/2.43.0" 2024-09-11T08:21:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: pgmap v151: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:38.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: osdmap e120: 8 total, 8 up, 8 in 2024-09-11T08:21:38.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:38.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: pgmap v151: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: osdmap e120: 8 total, 8 up, 8 in 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: pgmap v151: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2971259958' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi173-80687-14"}]': finished 2024-09-11T08:21:38.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: osdmap e120: 8 total, 8 up, 8 in 2024-09-11T08:21:38.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 93.8 scrub starts 2024-09-11T08:21:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 93.8 scrub ok 2024-09-11T08:21:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 14.8 deep-scrub starts 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 14.8 deep-scrub ok 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 93.9 scrub starts 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: 93.9 scrub ok 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: osdmap e121: 8 total, 8 up, 8 in 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/365441794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 93.8 scrub starts 2024-09-11T08:21:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 93.8 scrub ok 2024-09-11T08:21:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 14.8 deep-scrub starts 2024-09-11T08:21:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 14.8 deep-scrub ok 2024-09-11T08:21:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 93.9 scrub starts 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: 93.9 scrub ok 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: osdmap e121: 8 total, 8 up, 8 in 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/365441794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 93.8 scrub starts 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 93.8 scrub ok 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 14.8 deep-scrub starts 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 14.8 deep-scrub ok 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 93.9 scrub starts 2024-09-11T08:21:39.719 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: 93.9 scrub ok 2024-09-11T08:21:39.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1380526061' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi173-80353-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:39.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: osdmap e121: 8 total, 8 up, 8 in 2024-09-11T08:21:39.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/365441794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:39.720 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: 93.5 scrub starts 2024-09-11T08:21:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: 93.5 scrub ok 2024-09-11T08:21:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: pgmap v154: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: 14.5 deep-scrub starts 2024-09-11T08:21:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: 14.5 deep-scrub ok 2024-09-11T08:21:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:40.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:40 smithi175 ceph-mon[32813]: osdmap e122: 8 total, 8 up, 8 in 2024-09-11T08:21:40.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: 93.5 scrub starts 2024-09-11T08:21:40.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: 93.5 scrub ok 2024-09-11T08:21:40.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: pgmap v154: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: 14.5 deep-scrub starts 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: 14.5 deep-scrub ok 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[40835]: osdmap e122: 8 total, 8 up, 8 in 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: 93.5 scrub starts 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: 93.5 scrub ok 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: pgmap v154: 388 pgs: 64 unknown, 324 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 76 op/s 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: 14.5 deep-scrub starts 2024-09-11T08:21:40.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: 14.5 deep-scrub ok 2024-09-11T08:21:40.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:40.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi173-80342-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:40.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:40 smithi173 ceph-mon[29664]: osdmap e122: 8 total, 8 up, 8 in 2024-09-11T08:21:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:41 smithi175 ceph-mon[32813]: osdmap e123: 8 total, 8 up, 8 in 2024-09-11T08:21:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:41.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:41.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[29664]: osdmap e123: 8 total, 8 up, 8 in 2024-09-11T08:21:41.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:41.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:41.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:41.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[40835]: osdmap e123: 8 total, 8 up, 8 in 2024-09-11T08:21:41.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:41.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: pgmap v157: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: osdmap e124: 8 total, 8 up, 8 in 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/979180745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: 93.7 scrub starts 2024-09-11T08:21:42.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:42 smithi175 ceph-mon[32813]: 93.7 scrub ok 2024-09-11T08:21:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: pgmap v157: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: osdmap e124: 8 total, 8 up, 8 in 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/979180745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: 93.7 scrub starts 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[29664]: 93.7 scrub ok 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: pgmap v157: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/370164300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi173-80353-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4230237841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80733-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: osdmap e124: 8 total, 8 up, 8 in 2024-09-11T08:21:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/979180745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:42.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: 93.7 scrub starts 2024-09-11T08:21:42.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:42 smithi173 ceph-mon[40835]: 93.7 scrub ok 2024-09-11T08:21:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:43 smithi175 ceph-mon[32813]: 93.3 scrub starts 2024-09-11T08:21:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:43 smithi175 ceph-mon[32813]: 93.3 scrub ok 2024-09-11T08:21:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:43 smithi175 ceph-mon[32813]: osdmap e125: 8 total, 8 up, 8 in 2024-09-11T08:21:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[29664]: 93.3 scrub starts 2024-09-11T08:21:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[29664]: 93.3 scrub ok 2024-09-11T08:21:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[29664]: osdmap e125: 8 total, 8 up, 8 in 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[40835]: 93.3 scrub starts 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[40835]: 93.3 scrub ok 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi173-80342-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:43 smithi173 ceph-mon[40835]: osdmap e125: 8 total, 8 up, 8 in 2024-09-11T08:21:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: pgmap v160: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: osdmap e126: 8 total, 8 up, 8 in 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1442085759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: 93.1 scrub starts 2024-09-11T08:21:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:44 smithi175 ceph-mon[32813]: 93.1 scrub ok 2024-09-11T08:21:44.617 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: pgmap v160: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:44.617 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: osdmap e126: 8 total, 8 up, 8 in 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1442085759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: 93.1 scrub starts 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[40835]: 93.1 scrub ok 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: pgmap v160: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: osdmap e126: 8 total, 8 up, 8 in 2024-09-11T08:21:44.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1442085759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:44.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: 93.1 scrub starts 2024-09-11T08:21:44.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:44 smithi173 ceph-mon[29664]: 93.1 scrub ok 2024-09-11T08:21:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: osdmap e127: 8 total, 8 up, 8 in 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:45.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: osdmap e127: 8 total, 8 up, 8 in 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:45.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi173-80353-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: osdmap e127: 8 total, 8 up, 8 in 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:45.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:46.280 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: pgmap v163: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: osdmap e128: 8 total, 8 up, 8 in 2024-09-11T08:21:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: pgmap v163: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: osdmap e128: 8 total, 8 up, 8 in 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: pgmap v163: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2422156934' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80342-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: osdmap e128: 8 total, 8 up, 8 in 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[29664]: osdmap e129: 8 total, 8 up, 8 in 2024-09-11T08:21:47.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:47.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:47.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:47.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[40835]: osdmap e129: 8 total, 8 up, 8 in 2024-09-11T08:21:47.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:47.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:47.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:47.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:47 smithi175 ceph-mon[32813]: osdmap e129: 8 total, 8 up, 8 in 2024-09-11T08:21:47.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:47] "GET /metrics HTTP/1.1" 200 240291 "" "Prometheus/2.43.0" 2024-09-11T08:21:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: pgmap v166: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: osdmap e130: 8 total, 8 up, 8 in 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1921713832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: pgmap v166: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: osdmap e130: 8 total, 8 up, 8 in 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1921713832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: pgmap v166: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi173-80733-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2612144852' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: osdmap e130: 8 total, 8 up, 8 in 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1921713832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:48.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: osdmap e131: 8 total, 8 up, 8 in 2024-09-11T08:21:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2"}]: dispatch 2024-09-11T08:21:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: osdmap e131: 8 total, 8 up, 8 in 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2"}]: dispatch 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi173-80342-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: osdmap e131: 8 total, 8 up, 8 in 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2"}]: dispatch 2024-09-11T08:21:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:49.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: pgmap v169: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: osdmap e132: 8 total, 8 up, 8 in 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1942409755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: pgmap v169: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: osdmap e132: 8 total, 8 up, 8 in 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1942409755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: pgmap v169: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi173-80629-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: osdmap e132: 8 total, 8 up, 8 in 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1942409755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-09-11T08:21:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:21:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:21:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: osdmap e133: 8 total, 8 up, 8 in 2024-09-11T08:21:51.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4284445412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:51.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: osdmap e133: 8 total, 8 up, 8 in 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4284445412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi173-80353-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: osdmap e133: 8 total, 8 up, 8 in 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4284445412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-09-11T08:21:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: pgmap v172: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:52.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:21:52.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: osdmap e134: 8 total, 8 up, 8 in 2024-09-11T08:21:52.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:52.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: pgmap v172: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: osdmap e134: 8 total, 8 up, 8 in 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: pgmap v172: 364 pgs: 72 unknown, 292 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi173-80342-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: osdmap e134: 8 total, 8 up, 8 in 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2896655356' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]: dispatch 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-11T08:21:53.547 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: seed 80629 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (283 ms) 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (9 ms) 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (8 ms) 2024-09-11T08:21:53.548 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (11 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (4 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (3 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (10 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2024-09-11T08:21:53.549 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (7 ms) 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (7 ms) 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: osd_max_attr_size = 0 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1430 ms) 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (382 ms) 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: done waiting, doing copies 2024-09-11T08:21:53.550 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: waiting for final deep scrubs... 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: done waiting 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60644 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (4 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (5 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4565 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-11T08:21:53.551 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-09-11T08:21:53.552 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-11T08:21:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:21:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:53 smithi175 ceph-mon[32813]: osdmap e135: 8 total, 8 up, 8 in 2024-09-11T08:21:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/638119368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[29664]: osdmap e135: 8 total, 8 up, 8 in 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/638119368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi173-80629-1","app":"app1","key":"key1"}]': finished 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[40835]: osdmap e135: 8 total, 8 up, 8 in 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/638119368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: pgmap v175: 332 pgs: 32 unknown, 300 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:21:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: osdmap e136: 8 total, 8 up, 8 in 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3261069868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:54.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: pgmap v175: 332 pgs: 32 unknown, 300 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:21:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: osdmap e136: 8 total, 8 up, 8 in 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3261069868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: pgmap v175: 332 pgs: 32 unknown, 300 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:21:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi173-80353-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: osdmap e136: 8 total, 8 up, 8 in 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3261069868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:54.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:21:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:21:55.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: osdmap e137: 8 total, 8 up, 8 in 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:55.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: osdmap e137: 8 total, 8 up, 8 in 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi173-80342-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80629-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:21:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: osdmap e137: 8 total, 8 up, 8 in 2024-09-11T08:21:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:21:56.296 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:21:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:21:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:56 smithi175 ceph-mon[32813]: pgmap v178: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:56 smithi175 ceph-mon[32813]: osdmap e138: 8 total, 8 up, 8 in 2024-09-11T08:21:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3396040516' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[29664]: pgmap v178: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[29664]: osdmap e138: 8 total, 8 up, 8 in 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3396040516' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[40835]: pgmap v178: 300 pgs: 32 unknown, 268 active+clean; 592 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[40835]: osdmap e138: 8 total, 8 up, 8 in 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3396040516' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:21:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: osdmap e139: 8 total, 8 up, 8 in 2024-09-11T08:21:57.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:57.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:21:57] "GET /metrics HTTP/1.1" 200 238039 "" "Prometheus/2.43.0" 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: osdmap e139: 8 total, 8 up, 8 in 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80629-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi173-80353-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: osdmap e139: 8 total, 8 up, 8 in 2024-09-11T08:21:57.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: pgmap v181: 340 pgs: 19 creating+peering, 53 unknown, 268 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:21:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:58.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: osdmap e140: 8 total, 8 up, 8 in 2024-09-11T08:21:58.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: pgmap v181: 340 pgs: 19 creating+peering, 53 unknown, 268 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:21:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: osdmap e140: 8 total, 8 up, 8 in 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: pgmap v181: 340 pgs: 19 creating+peering, 53 unknown, 268 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2638876800' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi173-80342-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: osdmap e140: 8 total, 8 up, 8 in 2024-09-11T08:21:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:58.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:58.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.509 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP ( api_snapshots_pp: Running main() from gmock_main.cc 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [==========] Running 20 tests from 5 test suites. 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: seed 80733 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2671 ms) 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (1501 ms) 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2952 ms) 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1291 ms) 2024-09-11T08:21:59.510 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3783 ms) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (12198 ms total) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4053 ms) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4057 ms) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5798 ms) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4014 ms) 2024-09-11T08:21:59.511 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2009 ms) 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi173-80733-7 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: waiting for snaps to purge 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (18016 ms) 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (37947 ms total) 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (8 ms) 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5054 ms) 2024-09-11T08:21:59.512 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5062 ms total) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3015 ms) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2010 ms) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1929 ms) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2014 ms) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8968 ms total) 2024-09-11T08:21:59.513 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: 2024-09-11T08:21:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: osdmap e141: 8 total, 8 up, 8 in 2024-09-11T08:21:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3943210113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:21:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: osdmap e141: 8 total, 8 up, 8 in 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3943210113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:21:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: osdmap e141: 8 total, 8 up, 8 in 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3789654082' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3943210113' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]: dispatch 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:21:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:21:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: pgmap v184: 332 pgs: 72 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: osdmap e142: 8 total, 8 up, 8 in 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1425257014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:00.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: pgmap v184: 332 pgs: 72 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: osdmap e142: 8 total, 8 up, 8 in 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1425257014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: pgmap v184: 332 pgs: 72 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi173-80733-15"}]': finished 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi173-80353-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80629-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: osdmap e142: 8 total, 8 up, 8 in 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1425257014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:00.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:00.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: osdmap e143: 8 total, 8 up, 8 in 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:22:01.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: osdmap e143: 8 total, 8 up, 8 in 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:22:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi173-80342-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: osdmap e143: 8 total, 8 up, 8 in 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:22:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: pgmap v187: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: pgmap v188: 300 pgs: 300 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: osdmap e144: 8 total, 8 up, 8 in 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3060720023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:02.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: pgmap v187: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: pgmap v188: 300 pgs: 300 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: osdmap e144: 8 total, 8 up, 8 in 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3060720023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: pgmap v187: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: pgmap v188: 300 pgs: 300 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: osdmap e144: 8 total, 8 up, 8 in 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3060720023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:02.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: osdmap e145: 8 total, 8 up, 8 in 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: osdmap e145: 8 total, 8 up, 8 in 2024-09-11T08:22:03.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi173-80353-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:03.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi173-80342-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: osdmap e145: 8 total, 8 up, 8 in 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1501732574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:03.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:04 smithi175 ceph-mon[32813]: pgmap v191: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:22:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:04.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:04 smithi175 ceph-mon[32813]: osdmap e146: 8 total, 8 up, 8 in 2024-09-11T08:22:04.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[29664]: pgmap v191: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:22:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[29664]: osdmap e146: 8 total, 8 up, 8 in 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[40835]: pgmap v191: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80629-24"}]': finished 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[40835]: osdmap e146: 8 total, 8 up, 8 in 2024-09-11T08:22:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: osdmap e147: 8 total, 8 up, 8 in 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/571484603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1697576208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: osdmap e147: 8 total, 8 up, 8 in 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/571484603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1697576208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi173-80342-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: osdmap e147: 8 total, 8 up, 8 in 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/571484603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1697576208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:05.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:06.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:06 smithi175 ceph-mon[32813]: pgmap v194: 340 pgs: 80 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:06 smithi175 ceph-mon[32813]: osdmap e148: 8 total, 8 up, 8 in 2024-09-11T08:22:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[29664]: pgmap v194: 340 pgs: 80 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[29664]: osdmap e148: 8 total, 8 up, 8 in 2024-09-11T08:22:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[40835]: pgmap v194: 340 pgs: 80 unknown, 260 active+clean; 592 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi173-80629-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi173-80353-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[40835]: osdmap e148: 8 total, 8 up, 8 in 2024-09-11T08:22:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: osdmap e149: 8 total, 8 up, 8 in 2024-09-11T08:22:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: pgmap v197: 268 pgs: 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:07.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:07 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:07.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:07.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: osdmap e149: 8 total, 8 up, 8 in 2024-09-11T08:22:07.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: pgmap v197: 268 pgs: 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:07] "GET /metrics HTTP/1.1" 200 240517 "" "Prometheus/2.43.0" 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: osdmap e149: 8 total, 8 up, 8 in 2024-09-11T08:22:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: pgmap v197: 268 pgs: 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:07 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp api_aio: Running main() from gmock_main.cc 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [==========] Running 41 tests from 2 test suites. 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] Global test environment set-up. 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] 25 tests from LibRadosAio 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.TooBig (8121 ms) 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (4608 ms) 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (4286 ms) 2024-09-11T08:22:08.553 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3398 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2824 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3020 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3077 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3176 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (2651 ms) 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-09-11T08:22:08.554 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2992 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2981 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3009 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3240 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2769 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.Flush (2995 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2994 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3004 ms) 2024-09-11T08:22:08.555 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3017 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3017 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3249 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2773 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3013 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3181 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2772 ms) 2024-09-11T08:22:08.556 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3258 ms) 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] 25 tests from LibRadosAio (83426 ms total) 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-09-11T08:22:08.557 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6798 ms) 2024-09-11T08:22:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: osdmap e150: 8 total, 8 up, 8 in 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1771790001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2916619139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:08.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: osdmap e150: 8 total, 8 up, 8 in 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1771790001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2916619139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: osdmap e150: 8 total, 8 up, 8 in 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4292922353' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1771790001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2916619139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:08.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: osdmap e151: 8 total, 8 up, 8 in 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: pgmap v200: 332 pgs: 64 unknown, 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: osdmap e152: 8 total, 8 up, 8 in 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.346 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: osdmap e151: 8 total, 8 up, 8 in 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: pgmap v200: 332 pgs: 64 unknown, 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: osdmap e152: 8 total, 8 up, 8 in 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi173-80342-26"}]': finished 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi173-80353-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi173-80629-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: osdmap e151: 8 total, 8 up, 8 in 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]: dispatch 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.469 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: pgmap v200: 332 pgs: 64 unknown, 268 active+clean; 605 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-13"}]': finished 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi173-80342-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pg_num","val":"11"}]': finished 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: osdmap e152: 8 total, 8 up, 8 in 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:10.470 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]: dispatch 2024-09-11T08:22:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: osdmap e153: 8 total, 8 up, 8 in 2024-09-11T08:22:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2290199122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1191113264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: pgmap v203: 300 pgs: 63 creating+peering, 1 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: osdmap e153: 8 total, 8 up, 8 in 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2290199122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1191113264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: pgmap v203: 300 pgs: 63 creating+peering, 1 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi173-80423-1","var":"pgp_num","val":"11"}]': finished 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: osdmap e153: 8 total, 8 up, 8 in 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2290199122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1191113264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: pgmap v203: 300 pgs: 63 creating+peering, 1 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:11.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-09-11T08:22:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: osdmap e154: 8 total, 8 up, 8 in 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: osdmap e154: 8 total, 8 up, 8 in 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi173-80342-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi173-80629-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi173-80353-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: osdmap e154: 8 total, 8 up, 8 in 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: osdmap e155: 8 total, 8 up, 8 in 2024-09-11T08:22:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:13 smithi175 ceph-mon[32813]: pgmap v206: 276 pgs: 40 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: osdmap e155: 8 total, 8 up, 8 in 2024-09-11T08:22:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[29664]: pgmap v206: 276 pgs: 40 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: osdmap e155: 8 total, 8 up, 8 in 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:13 smithi173 ceph-mon[40835]: pgmap v206: 276 pgs: 40 unknown, 236 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: osdmap e156: 8 total, 8 up, 8 in 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: osdmap e156: 8 total, 8 up, 8 in 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:14.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:15.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: osdmap e156: 8 total, 8 up, 8 in 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:16.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: osdmap e157: 8 total, 8 up, 8 in 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: pgmap v209: 299 pgs: 64 unknown, 235 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: osdmap e158: 8 total, 8 up, 8 in 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: osdmap e157: 8 total, 8 up, 8 in 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: pgmap v209: 299 pgs: 64 unknown, 235 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: osdmap e158: 8 total, 8 up, 8 in 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:16.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2689306132' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi173-80353-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: osdmap e157: 8 total, 8 up, 8 in 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]: dispatch 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: pgmap v209: 299 pgs: 64 unknown, 235 active+clean; 609 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi173-80629-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3962509163' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi173-80342-27"}]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: osdmap e158: 8 total, 8 up, 8 in 2024-09-11T08:22:16.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:16.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]': finished 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: osdmap e159: 8 total, 8 up, 8 in 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]': finished 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: osdmap e159: 8 total, 8 up, 8 in 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-15", "mode": "writeback"}]': finished 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi173-80342-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: osdmap e159: 8 total, 8 up, 8 in 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/478520395' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]: dispatch 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComple: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4051 ms) 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4148 ms) 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T08:22:17.722 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3994 ms) 2024-09-11T08:22:17.723 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12193 ms total) 2024-09-11T08:22:17.723 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: 2024-09-11T08:22:17.723 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-09-11T08:22:17.723 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [==========] 20 tests from 5 test suites ran. (99269 ms total) 2024-09-11T08:22:17.723 INFO:tasks.workunit.client.0.smithi173.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-09-11T08:22:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:17] "GET /metrics HTTP/1.1" 200 240517 "" "Prometheus/2.43.0" 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: pgmap v212: 299 pgs: 32 unknown, 8 creating+peering, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: osdmap e160: 8 total, 8 up, 8 in 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: pgmap v212: 299 pgs: 32 unknown, 8 creating+peering, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: osdmap e160: 8 total, 8 up, 8 in 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: pgmap v212: 299 pgs: 32 unknown, 8 creating+peering, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3628051739' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi173-80353-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi173-80733-20"}]': finished 2024-09-11T08:22:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: osdmap e160: 8 total, 8 up, 8 in 2024-09-11T08:22:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:19.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:19.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: osdmap e161: 8 total, 8 up, 8 in 2024-09-11T08:22:19.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:19.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: osdmap e161: 8 total, 8 up, 8 in 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi173-80342-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: osdmap e161: 8 total, 8 up, 8 in 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]: dispatch 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]: dispatch 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout:67382 ms total) 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (100 ms) 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (100 ms total) 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-09-11T08:22:19.495 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (43 ms) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (6 ms) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (49 ms total) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (38 ms) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (4 ms) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (42 ms total) 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-11T08:22:19.496 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (32 ms) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (5 ms) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (37 ms total) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1014 ms) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1014 ms total) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (101064 ms total) 2024-09-11T08:22:19.497 INFO:tasks.workunit.client.0.smithi173.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-09-11T08:22:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: pgmap v215: 267 pgs: 8 unknown, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: osdmap e162: 8 total, 8 up, 8 in 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2388721915' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: pgmap v215: 267 pgs: 8 unknown, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: osdmap e162: 8 total, 8 up, 8 in 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2388721915' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: pgmap v215: 267 pgs: 8 unknown, 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 31 B/s, 0 objects/s recovering 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3961051950' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi173-80629-36"}]': finished 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-15"}]': finished 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: osdmap e162: 8 total, 8 up, 8 in 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2388721915' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:20 smithi175 ceph-mon[32813]: osdmap e163: 8 total, 8 up, 8 in 2024-09-11T08:22:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[29664]: osdmap e163: 8 total, 8 up, 8 in 2024-09-11T08:22:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi173-80353-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[40835]: osdmap e163: 8 total, 8 up, 8 in 2024-09-11T08:22:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: pgmap v218: 259 pgs: 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-11T08:22:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-11T08:22:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: osdmap e164: 8 total, 8 up, 8 in 2024-09-11T08:22:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: pgmap v218: 259 pgs: 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: osdmap e164: 8 total, 8 up, 8 in 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: pgmap v218: 259 pgs: 259 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:22:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi173-80423-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: osdmap e164: 8 total, 8 up, 8 in 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]: dispatch 2024-09-11T08:22:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: osdmap e165: 8 total, 8 up, 8 in 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761469300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:23.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:23.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: osdmap e165: 8 total, 8 up, 8 in 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761469300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1155390729' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-09-11T08:22:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1117920069' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi173-80342-28"}]': finished 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: osdmap e165: 8 total, 8 up, 8 in 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761469300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:23.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: pgmap v221: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: osdmap e166: 8 total, 8 up, 8 in 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: pgmap v221: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: osdmap e166: 8 total, 8 up, 8 in 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.219 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: pgmap v221: 291 pgs: 64 unknown, 227 active+clean; 585 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi173-80353-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi173-80342-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: osdmap e166: 8 total, 8 up, 8 in 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:24.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:24.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.221 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:24.222 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.222 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (6833 ms) 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (21440 ms) 2024-09-11T08:22:24.712 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5880 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3019 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2979 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2989 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2993 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3015 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2990 ms) 2024-09-11T08:22:24.713 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3017 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2989 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3011 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3015 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3010 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3014 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3023 ms) 2024-09-11T08:22:24.714 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2926 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3018 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3014 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3258 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2767 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2943 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3015 ms) 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-09-11T08:22:24.715 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2996 ms) 2024-09-11T08:22:24.716 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-09-11T08:22:24.716 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3003 ms) 2024-09-11T08:22:24.716 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-09-11T08:22:24.716 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3008 ms) 2024-09-11T08:22:24.716 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-11T08:22:25.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: osdmap e167: 8 total, 8 up, 8 in 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: osdmap e167: 8 total, 8 up, 8 in 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi173-80423-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: osdmap e167: 8 total, 8 up, 8 in 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:25.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]: dispatch 2024-09-11T08:22:26.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:26.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: pgmap v224: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]': finished 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: osdmap e168: 8 total, 8 up, 8 in 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:26.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:26.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: pgmap v224: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:26.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]': finished 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: osdmap e168: 8 total, 8 up, 8 in 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: pgmap v224: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:26.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi173-80342-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-17", "mode": "writeback"}]': finished 2024-09-11T08:22:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: osdmap e168: 8 total, 8 up, 8 in 2024-09-11T08:22:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:26.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:27.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:27.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:27.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:27.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:27.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: osdmap e169: 8 total, 8 up, 8 in 2024-09-11T08:22:27.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: osdmap e169: 8 total, 8 up, 8 in 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi173-80423-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1055570706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi173-80353-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: osdmap e169: 8 total, 8 up, 8 in 2024-09-11T08:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]: dispatch 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio: : entry=11 expected=11 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:863748b0:::15:head 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:863748b0:::15:head expected=30:863748b0:::15:head 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:863748b0:::15:head -> 15 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=15 expected=15 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:c4fdafeb:::6:head 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:c4fdafeb:::6:head expected=30:c4fdafeb:::6:head 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:c4fdafeb:::6:head -> 6 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=6 expected=6 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:f905c69b:::2:head 2024-09-11T08:22:27.562 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:f905c69b:::2:head expected=30:f905c69b:::2:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:f905c69b:::2:head -> 2 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=2 expected=2 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:e960b815:::9:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:e960b815:::9:head expected=30:e960b815:::9:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:e960b815:::9:head -> 9 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=9 expected=9 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:6cac518f:::0:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:6cac518f:::0:head expected=30:6cac518f:::0:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:6cac518f:::0:head -> 0 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=0 expected=0 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:02547ec2:::1:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:02547ec2:::1:head expected=30:02547ec2:::1:head 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:02547ec2:::1:head -> 1 2024-09-11T08:22:27.563 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=1 expected=1 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:62a1935d:::14:head 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:62a1935d:::14:head expected=30:62a1935d:::14:head 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:62a1935d:::14:head -> 14 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=14 expected=14 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : seek to 30:5c6b0b28:::7:head 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : cursor()=30:5c6b0b28:::7:head expected=30:5c6b0b28:::7:head 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: > 30:5c6b0b28:::7:head -> 7 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: : entry=7 expected=7 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (203 ms) 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (82766 ms) 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-11T08:22:27.564 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: split 0/5 -> MIN 30:33333333::::head 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: split 1/5 -> 30:33333333::::head 30:66666666::::head 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: split 2/5 -> 30:66666666::::head 30:99999999::::head 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: split 3/5 -> 30:99999999::::head 30:cccccccc::::head 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: split 4/5 -> 30:cccccccc::::head MAX 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (13950 ms) 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 7 tests from LibRadosList (97395 ms total) 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1049 ms) 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo1,foo2,foo3 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo1 2024-09-11T08:22:27.565 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo2 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo3 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo1,foo4,foo5 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo4 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo5 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo1 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset foo6,foo7 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo7 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: foo6 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo4 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo5 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns2:foo7 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns2:foo6 2024-09-11T08:22:27.566 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: ns1:foo1 2024-09-11T08:22:27.567 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo1 2024-09-11T08:22:27.567 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo2 2024-09-11T08:22:27.567 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: :foo3 2024-09-11T08:22:27.567 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (32 ms) 2024-09-11T08:22:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:27] "GET /metrics HTTP/1.1" 200 235667 "" "Prometheus/2.43.0" 2024-09-11T08:22:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:27 smithi175 ceph-mon[32813]: pgmap v227: 276 pgs: 38 creating+peering, 10 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:27 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:27 smithi175 ceph-mon[32813]: osdmap e170: 8 total, 8 up, 8 in 2024-09-11T08:22:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:28.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[29664]: pgmap v227: 276 pgs: 38 creating+peering, 10 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:28.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[29664]: osdmap e170: 8 total, 8 up, 8 in 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[40835]: pgmap v227: 276 pgs: 38 creating+peering, 10 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-17"}]': finished 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[40835]: osdmap e170: 8 total, 8 up, 8 in 2024-09-11T08:22:28.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: osdmap e171: 8 total, 8 up, 8 in 2024-09-11T08:22:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: pgmap v230: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:29 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: osdmap e171: 8 total, 8 up, 8 in 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: pgmap v230: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: osdmap e171: 8 total, 8 up, 8 in 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]: dispatch 2024-09-11T08:22:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: pgmap v230: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:29.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:29 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: osdmap e172: 8 total, 8 up, 8 in 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:30.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:30.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: osdmap e172: 8 total, 8 up, 8 in 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:30.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2059598972' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi173-80353-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2957194246' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi173-80342-29"}]': finished 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: osdmap e172: 8 total, 8 up, 8 in 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315570376' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:30.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:30.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: osdmap e173: 8 total, 8 up, 8 in 2024-09-11T08:22:31.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:31 smithi175 ceph-mon[32813]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:22:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: osdmap e173: 8 total, 8 up, 8 in 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[29664]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi173-80423-2"}]': finished 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi173-80342-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: osdmap e173: 8 total, 8 up, 8 in 2024-09-11T08:22:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:31 smithi173 ceph-mon[40835]: pgmap v233: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:22:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: osdmap e174: 8 total, 8 up, 8 in 2024-09-11T08:22:32.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:32.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: osdmap e174: 8 total, 8 up, 8 in 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: osdmap e174: 8 total, 8 up, 8 in 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:32.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:33.519 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 1 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 10 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 13 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 7 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 14 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 0 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 15 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 11 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 5 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 8 0 2024-09-11T08:22:33.520 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 6 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 3 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 4 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 12 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 9 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 2 0 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (41 ms) 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 3 tests from LibRadosListEC (1122 ms total) 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3006 ms) 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] 1 test from LibRadosListNP (3006 ms total) 2024-09-11T08:22:33.521 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: 2024-09-11T08:22:33.522 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [----------] Global test environment tear-down 2024-09-11T08:22:33.522 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [==========] 11 tests from 3 test suites ran. (115146 ms total) 2024-09-11T08:22:33.522 INFO:tasks.workunit.client.0.smithi173.stdout: api_list: [ PASSED ] 11 tests. 2024-09-11T08:22:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: osdmap e175: 8 total, 8 up, 8 in 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: pgmap v236: 300 pgs: 72 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]': finished 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-11T08:22:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:33 smithi175 ceph-mon[32813]: osdmap e176: 8 total, 8 up, 8 in 2024-09-11T08:22:33.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: osdmap e175: 8 total, 8 up, 8 in 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: pgmap v236: 300 pgs: 72 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[29664]: osdmap e176: 8 total, 8 up, 8 in 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi173-80342-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80423-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3507641745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi173-80353-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: osdmap e175: 8 total, 8 up, 8 in 2024-09-11T08:22:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]: dispatch 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1893384638' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: pgmap v236: 300 pgs: 72 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-19", "mode": "writeback"}]': finished 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi173-80423-3","pool2":"test-rados-api-smithi173-80423-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-09-11T08:22:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:33 smithi173 ceph-mon[40835]: osdmap e176: 8 total, 8 up, 8 in 2024-09-11T08:22:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:34 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:34 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: osdmap e177: 8 total, 8 up, 8 in 2024-09-11T08:22:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-mon[32813]: pgmap v239: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: osdmap e177: 8 total, 8 up, 8 in 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[29664]: pgmap v239: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: osdmap e177: 8 total, 8 up, 8 in 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]: dispatch 2024-09-11T08:22:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:35.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:35.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:35.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:35 smithi173 ceph-mon[40835]: pgmap v239: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:36.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: osdmap e178: 8 total, 8 up, 8 in 2024-09-11T08:22:36.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: osdmap e178: 8 total, 8 up, 8 in 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-19"}]': finished 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi173-80353-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: osdmap e178: 8 total, 8 up, 8 in 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2975459597' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/500547844' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]: dispatch 2024-09-11T08:22:36.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]': finished 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: osdmap e179: 8 total, 8 up, 8 in 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:37 smithi175 ceph-mon[32813]: pgmap v242: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 KiB/s wr, 78 op/s 2024-09-11T08:22:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:37] "GET /metrics HTTP/1.1" 200 230889 "" "Prometheus/2.43.0" 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]': finished 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: osdmap e179: 8 total, 8 up, 8 in 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[29664]: pgmap v242: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 KiB/s wr, 78 op/s 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi173-80342-30"}]': finished 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "PoolEIOFlag_smithi173-80353-33", "var": "eio", "val": "true"}]': finished 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: osdmap e179: 8 total, 8 up, 8 in 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:37 smithi173 ceph-mon[40835]: pgmap v242: 228 pgs: 228 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 77 KiB/s wr, 78 op/s 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: osdmap e180: 8 total, 8 up, 8 in 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: osdmap e180: 8 total, 8 up, 8 in 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi173-80342-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: osdmap e180: 8 total, 8 up, 8 in 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:39.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: osdmap e181: 8 total, 8 up, 8 in 2024-09-11T08:22:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: pgmap v245: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: osdmap e182: 8 total, 8 up, 8 in 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: osdmap e181: 8 total, 8 up, 8 in 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: pgmap v245: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: osdmap e182: 8 total, 8 up, 8 in 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: osdmap e181: 8 total, 8 up, 8 in 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: pgmap v245: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi173-80342-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1171933302' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi173-80353-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: osdmap e182: 8 total, 8 up, 8 in 2024-09-11T08:22:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:41 smithi175 ceph-mon[32813]: osdmap e183: 8 total, 8 up, 8 in 2024-09-11T08:22:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:41 smithi175 ceph-mon[32813]: pgmap v248: 236 pgs: 4 creating+activating, 232 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[29664]: osdmap e183: 8 total, 8 up, 8 in 2024-09-11T08:22:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[29664]: pgmap v248: 236 pgs: 4 creating+activating, 232 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[40835]: osdmap e183: 8 total, 8 up, 8 in 2024-09-11T08:22:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]: dispatch 2024-09-11T08:22:41.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:41 smithi173 ceph-mon[40835]: pgmap v248: 236 pgs: 4 creating+activating, 232 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:22:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]': finished 2024-09-11T08:22:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: osdmap e184: 8 total, 8 up, 8 in 2024-09-11T08:22:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3392669023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]': finished 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: osdmap e184: 8 total, 8 up, 8 in 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3392669023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-21", "mode": "writeback"}]': finished 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: osdmap e184: 8 total, 8 up, 8 in 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3392669023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: osdmap e185: 8 total, 8 up, 8 in 2024-09-11T08:22:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:43 smithi175 ceph-mon[32813]: pgmap v251: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: osdmap e185: 8 total, 8 up, 8 in 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[29664]: pgmap v251: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi173-80353-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: osdmap e185: 8 total, 8 up, 8 in 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2408694456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]: dispatch 2024-09-11T08:22:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]: dispatch 2024-09-11T08:22:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:43 smithi173 ceph-mon[40835]: pgmap v251: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: osdmap e186: 8 total, 8 up, 8 in 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: osdmap e186: 8 total, 8 up, 8 in 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:44.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi173-80342-31"}]': finished 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-21"}]': finished 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: osdmap e186: 8 total, 8 up, 8 in 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:44.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: osdmap e187: 8 total, 8 up, 8 in 2024-09-11T08:22:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2268204189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-mon[32813]: pgmap v254: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: osdmap e187: 8 total, 8 up, 8 in 2024-09-11T08:22:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2268204189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[29664]: pgmap v254: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi173-80342-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: osdmap e187: 8 total, 8 up, 8 in 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2268204189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:45 smithi173 ceph-mon[40835]: pgmap v254: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:46.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: osdmap e188: 8 total, 8 up, 8 in 2024-09-11T08:22:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:46.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:46.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:46.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: osdmap e188: 8 total, 8 up, 8 in 2024-09-11T08:22:46.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: osdmap e188: 8 total, 8 up, 8 in 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:46.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:47] "GET /metrics HTTP/1.1" 200 230889 "" "Prometheus/2.43.0" 2024-09-11T08:22:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: osdmap e189: 8 total, 8 up, 8 in 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/987443463' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[29664]: pgmap v257: 300 pgs: 14 creating+peering, 58 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: osdmap e189: 8 total, 8 up, 8 in 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/987443463' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:47 smithi173 ceph-mon[40835]: pgmap v257: 300 pgs: 14 creating+peering, 58 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi173-80342-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: osdmap e189: 8 total, 8 up, 8 in 2024-09-11T08:22:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/987443463' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:48.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:47 smithi175 ceph-mon[32813]: pgmap v257: 300 pgs: 14 creating+peering, 58 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[29664]: osdmap e190: 8 total, 8 up, 8 in 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[40835]: osdmap e190: 8 total, 8 up, 8 in 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:48 smithi175 ceph-mon[32813]: osdmap e190: 8 total, 8 up, 8 in 2024-09-11T08:22:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: osdmap e191: 8 total, 8 up, 8 in 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/300483814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[29664]: pgmap v260: 324 pgs: 14 creating+peering, 82 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: osdmap e191: 8 total, 8 up, 8 in 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/300483814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:49.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:49 smithi173 ceph-mon[40835]: pgmap v260: 324 pgs: 14 creating+peering, 82 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:22:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: osdmap e191: 8 total, 8 up, 8 in 2024-09-11T08:22:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/300483814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:50.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:49 smithi175 ceph-mon[32813]: pgmap v260: 324 pgs: 14 creating+peering, 82 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:22:50.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: osdmap e192: 8 total, 8 up, 8 in 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:50.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: osdmap e192: 8 total, 8 up, 8 in 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:50.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi173-80353-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: osdmap e192: 8 total, 8 up, 8 in 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1963561184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]: dispatch 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]: dispatch 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:22:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:22:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]': finished 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: osdmap e193: 8 total, 8 up, 8 in 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[29664]: pgmap v263: 292 pgs: 292 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]': finished 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: osdmap e193: 8 total, 8 up, 8 in 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:51 smithi173 ceph-mon[40835]: pgmap v263: 292 pgs: 292 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-23", "mode": "writeback"}]': finished 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi173-80342-32"}]': finished 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: osdmap e193: 8 total, 8 up, 8 in 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:51.996 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:51 smithi175 ceph-mon[32813]: pgmap v263: 292 pgs: 292 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:22:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: osdmap e194: 8 total, 8 up, 8 in 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: osdmap e194: 8 total, 8 up, 8 in 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi173-80342-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:22:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: osdmap e194: 8 total, 8 up, 8 in 2024-09-11T08:22:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:53.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:53.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[29664]: osdmap e195: 8 total, 8 up, 8 in 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[29664]: pgmap v266: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[40835]: osdmap e195: 8 total, 8 up, 8 in 2024-09-11T08:22:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:53.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:53.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:53 smithi173 ceph-mon[40835]: pgmap v266: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:22:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:22:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:53 smithi175 ceph-mon[32813]: osdmap e195: 8 total, 8 up, 8 in 2024-09-11T08:22:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]: dispatch 2024-09-11T08:22:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:53 smithi175 ceph-mon[32813]: pgmap v266: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:22:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: osdmap e196: 8 total, 8 up, 8 in 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2575352720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: osdmap e196: 8 total, 8 up, 8 in 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2575352720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:22:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi173-80342-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-23"}]': finished 2024-09-11T08:22:55.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: osdmap e196: 8 total, 8 up, 8 in 2024-09-11T08:22:55.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2575352720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:55.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:22:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:22:55.945 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:55.945 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:55 smithi175 ceph-mon[32813]: osdmap e197: 8 total, 8 up, 8 in 2024-09-11T08:22:55.945 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:55 smithi175 ceph-mon[32813]: pgmap v269: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:55.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:55.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[40835]: osdmap e197: 8 total, 8 up, 8 in 2024-09-11T08:22:55.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[40835]: pgmap v269: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[29664]: osdmap e197: 8 total, 8 up, 8 in 2024-09-11T08:22:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:55 smithi173 ceph-mon[29664]: pgmap v269: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:56.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:22:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:22:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: osdmap e198: 8 total, 8 up, 8 in 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/29217990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: osdmap e198: 8 total, 8 up, 8 in 2024-09-11T08:22:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/29217990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: osdmap e198: 8 total, 8 up, 8 in 2024-09-11T08:22:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/29217990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:22:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:22:57] "GET /metrics HTTP/1.1" 200 235770 "" "Prometheus/2.43.0" 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: osdmap e199: 8 total, 8 up, 8 in 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[29664]: pgmap v272: 292 pgs: 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: osdmap e199: 8 total, 8 up, 8 in 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:57 smithi173 ceph-mon[40835]: pgmap v272: 292 pgs: 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: osdmap e199: 8 total, 8 up, 8 in 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3094811634' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]: dispatch 2024-09-11T08:22:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:57 smithi175 ceph-mon[32813]: pgmap v272: 292 pgs: 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:22:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: osdmap e200: 8 total, 8 up, 8 in 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:58.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: osdmap e200: 8 total, 8 up, 8 in 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:22:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi173-80342-33"}]': finished 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: osdmap e200: 8 total, 8 up, 8 in 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:22:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: osdmap e201: 8 total, 8 up, 8 in 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: pgmap v275: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:00.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:22:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:00.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: osdmap e201: 8 total, 8 up, 8 in 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: pgmap v275: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2890318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:00.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi173-80342-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: osdmap e201: 8 total, 8 up, 8 in 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: pgmap v275: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:00.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:22:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: osdmap e202: 8 total, 8 up, 8 in 2024-09-11T08:23:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1482129708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]': finished 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: osdmap e203: 8 total, 8 up, 8 in 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:01.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: osdmap e202: 8 total, 8 up, 8 in 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1482129708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]': finished 2024-09-11T08:23:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: osdmap e203: 8 total, 8 up, 8 in 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: osdmap e202: 8 total, 8 up, 8 in 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1482129708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi173-80342-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:01.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-25", "mode": "writeback"}]': finished 2024-09-11T08:23:01.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:01.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: osdmap e203: 8 total, 8 up, 8 in 2024-09-11T08:23:01.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:01.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: pgmap v278: 364 pgs: 8 creating+peering, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:23:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: osdmap e204: 8 total, 8 up, 8 in 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3132001324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:23:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: pgmap v278: 364 pgs: 8 creating+peering, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: osdmap e204: 8 total, 8 up, 8 in 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3132001324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:23:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: pgmap v278: 364 pgs: 8 creating+peering, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: osdmap e204: 8 total, 8 up, 8 in 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3132001324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:23:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: osdmap e205: 8 total, 8 up, 8 in 2024-09-11T08:23:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:03.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:03.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: osdmap e205: 8 total, 8 up, 8 in 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-25"}]': finished 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi173-80353-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:03.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: osdmap e205: 8 total, 8 up, 8 in 2024-09-11T08:23:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:03 smithi175 ceph-mon[32813]: pgmap v281: 388 pgs: 32 unknown, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:03 smithi175 ceph-mon[32813]: osdmap e206: 8 total, 8 up, 8 in 2024-09-11T08:23:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[29664]: pgmap v281: 388 pgs: 32 unknown, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[29664]: osdmap e206: 8 total, 8 up, 8 in 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[40835]: pgmap v281: 388 pgs: 32 unknown, 356 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[40835]: osdmap e206: 8 total, 8 up, 8 in 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4155294871' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]: dispatch 2024-09-11T08:23:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: osdmap e207: 8 total, 8 up, 8 in 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: osdmap e207: 8 total, 8 up, 8 in 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi173-80342-34"}]': finished 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: osdmap e207: 8 total, 8 up, 8 in 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:06.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: pgmap v284: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: osdmap e208: 8 total, 8 up, 8 in 2024-09-11T08:23:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:06.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: pgmap v284: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: osdmap e208: 8 total, 8 up, 8 in 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: pgmap v284: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi173-80342-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: osdmap e208: 8 total, 8 up, 8 in 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:06 smithi175 ceph-mon[32813]: osdmap e209: 8 total, 8 up, 8 in 2024-09-11T08:23:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[29664]: osdmap e209: 8 total, 8 up, 8 in 2024-09-11T08:23:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[40835]: osdmap e209: 8 total, 8 up, 8 in 2024-09-11T08:23:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:07] "GET /metrics HTTP/1.1" 200 235788 "" "Prometheus/2.43.0" 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: pgmap v287: 260 pgs: 260 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: osdmap e210: 8 total, 8 up, 8 in 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: pgmap v287: 260 pgs: 260 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: osdmap e210: 8 total, 8 up, 8 in 2024-09-11T08:23:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: pgmap v287: 260 pgs: 260 active+clean; 584 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi173-80342-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: osdmap e210: 8 total, 8 up, 8 in 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: osdmap e211: 8 total, 8 up, 8 in 2024-09-11T08:23:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1770952699' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:09 smithi175 ceph-mon[32813]: pgmap v290: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: osdmap e211: 8 total, 8 up, 8 in 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1770952699' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[29664]: pgmap v290: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: osdmap e211: 8 total, 8 up, 8 in 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1770952699' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]: dispatch 2024-09-11T08:23:09.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:09 smithi173 ceph-mon[40835]: pgmap v290: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:10.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]': finished 2024-09-11T08:23:10.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: osdmap e212: 8 total, 8 up, 8 in 2024-09-11T08:23:10.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:10.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:10.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]': finished 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: osdmap e212: 8 total, 8 up, 8 in 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi173-80353-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-27", "mode": "writeback"}]': finished 2024-09-11T08:23:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: osdmap e212: 8 total, 8 up, 8 in 2024-09-11T08:23:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:10.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: osdmap e213: 8 total, 8 up, 8 in 2024-09-11T08:23:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:11 smithi175 ceph-mon[32813]: pgmap v293: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T08:23:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: osdmap e213: 8 total, 8 up, 8 in 2024-09-11T08:23:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[29664]: pgmap v293: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: osdmap e213: 8 total, 8 up, 8 in 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2952216304' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:11 smithi173 ceph-mon[40835]: pgmap v293: 228 pgs: 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T08:23:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: osdmap e214: 8 total, 8 up, 8 in 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3147912967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:12.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: osdmap e214: 8 total, 8 up, 8 in 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3147912967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi173-80342-35"}]': finished 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: osdmap e214: 8 total, 8 up, 8 in 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3147912967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:12.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:12.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: osdmap e215: 8 total, 8 up, 8 in 2024-09-11T08:23:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:13 smithi175 ceph-mon[32813]: pgmap v296: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: osdmap e215: 8 total, 8 up, 8 in 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[29664]: pgmap v296: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-27"}]': finished 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi173-80353-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: osdmap e215: 8 total, 8 up, 8 in 2024-09-11T08:23:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:13 smithi173 ceph-mon[40835]: pgmap v296: 260 pgs: 32 unknown, 228 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T08:23:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: osdmap e216: 8 total, 8 up, 8 in 2024-09-11T08:23:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: osdmap e217: 8 total, 8 up, 8 in 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:14.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: osdmap e216: 8 total, 8 up, 8 in 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: osdmap e217: 8 total, 8 up, 8 in 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: osdmap e216: 8 total, 8 up, 8 in 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.869 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi173-80342-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: osdmap e217: 8 total, 8 up, 8 in 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:14.870 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:15 smithi175 ceph-mon[32813]: pgmap v299: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:16.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:16.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:15 smithi173 ceph-mon[29664]: pgmap v299: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:15 smithi173 ceph-mon[40835]: pgmap v299: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: osdmap e218: 8 total, 8 up, 8 in 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: osdmap e219: 8 total, 8 up, 8 in 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: osdmap e218: 8 total, 8 up, 8 in 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: osdmap e219: 8 total, 8 up, 8 in 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: osdmap e218: 8 total, 8 up, 8 in 2024-09-11T08:23:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: osdmap e219: 8 total, 8 up, 8 in 2024-09-11T08:23:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:17] "GET /metrics HTTP/1.1" 200 235788 "" "Prometheus/2.43.0" 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: pgmap v302: 236 pgs: 1 active, 10 creating+peering, 19 creating+activating, 8 unknown, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: osdmap e220: 8 total, 8 up, 8 in 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: pgmap v302: 236 pgs: 1 active, 10 creating+peering, 19 creating+activating, 8 unknown, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: osdmap e220: 8 total, 8 up, 8 in 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: pgmap v302: 236 pgs: 1 active, 10 creating+peering, 19 creating+activating, 8 unknown, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:23:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: osdmap e220: 8 total, 8 up, 8 in 2024-09-11T08:23:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1772550278' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]: dispatch 2024-09-11T08:23:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:18.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: osdmap e221: 8 total, 8 up, 8 in 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:19 smithi175 ceph-mon[32813]: pgmap v305: 228 pgs: 1 active, 10 creating+peering, 19 creating+activating, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: osdmap e221: 8 total, 8 up, 8 in 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[29664]: pgmap v305: 228 pgs: 1 active, 10 creating+peering, 19 creating+activating, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi173-80342-36"}]': finished 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: osdmap e221: 8 total, 8 up, 8 in 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:19 smithi173 ceph-mon[40835]: pgmap v305: 228 pgs: 1 active, 10 creating+peering, 19 creating+activating, 198 active+clean; 583 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: osdmap e222: 8 total, 8 up, 8 in 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: osdmap e222: 8 total, 8 up, 8 in 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi173-80342-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: osdmap e222: 8 total, 8 up, 8 in 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2591431641' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:21.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]': finished 2024-09-11T08:23:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: osdmap e223: 8 total, 8 up, 8 in 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: pgmap v308: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: osdmap e224: 8 total, 8 up, 8 in 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]': finished 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: osdmap e223: 8 total, 8 up, 8 in 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: pgmap v308: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: osdmap e224: 8 total, 8 up, 8 in 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-29", "mode": "writeback"}]': finished 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-46"}]': finished 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: osdmap e223: 8 total, 8 up, 8 in 2024-09-11T08:23:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: pgmap v308: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi173-80342-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi173-80353-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: osdmap e224: 8 total, 8 up, 8 in 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:22.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:23 smithi175 ceph-mon[32813]: osdmap e225: 8 total, 8 up, 8 in 2024-09-11T08:23:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:23 smithi175 ceph-mon[32813]: pgmap v311: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:23.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:23 smithi173 ceph-mon[29664]: osdmap e225: 8 total, 8 up, 8 in 2024-09-11T08:23:23.970 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:23 smithi173 ceph-mon[29664]: pgmap v311: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:23.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:23 smithi173 ceph-mon[40835]: osdmap e225: 8 total, 8 up, 8 in 2024-09-11T08:23:23.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:23 smithi173 ceph-mon[40835]: pgmap v311: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:24.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: osdmap e226: 8 total, 8 up, 8 in 2024-09-11T08:23:24.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:24.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:24.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: osdmap e226: 8 total, 8 up, 8 in 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi173-80353-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: osdmap e226: 8 total, 8 up, 8 in 2024-09-11T08:23:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:24.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: osdmap e227: 8 total, 8 up, 8 in 2024-09-11T08:23:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-mon[32813]: pgmap v314: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: osdmap e227: 8 total, 8 up, 8 in 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[29664]: pgmap v314: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: osdmap e227: 8 total, 8 up, 8 in 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3909886713' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]: dispatch 2024-09-11T08:23:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]: dispatch 2024-09-11T08:23:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:25 smithi173 ceph-mon[40835]: pgmap v314: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:26.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: osdmap e228: 8 total, 8 up, 8 in 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: osdmap e228: 8 total, 8 up, 8 in 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi173-80342-37"}]': finished 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-29"}]': finished 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: osdmap e228: 8 total, 8 up, 8 in 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:26.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:26.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: osdmap e229: 8 total, 8 up, 8 in 2024-09-11T08:23:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:27 smithi175 ceph-mon[32813]: pgmap v317: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:27] "GET /metrics HTTP/1.1" 200 228474 "" "Prometheus/2.43.0" 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: osdmap e229: 8 total, 8 up, 8 in 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[29664]: pgmap v317: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi173-80342-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: osdmap e229: 8 total, 8 up, 8 in 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1015328825' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]: dispatch 2024-09-11T08:23:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:27 smithi173 ceph-mon[40835]: pgmap v317: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: osdmap e230: 8 total, 8 up, 8 in 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:28.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: osdmap e230: 8 total, 8 up, 8 in 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:28.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi173-80353-47"}]': finished 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: osdmap e230: 8 total, 8 up, 8 in 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:28.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: osdmap e231: 8 total, 8 up, 8 in 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: pgmap v320: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:29 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: osdmap e231: 8 total, 8 up, 8 in 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: pgmap v320: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi173-80342-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi173-80353-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: osdmap e231: 8 total, 8 up, 8 in 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: pgmap v320: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-09-11T08:23:30.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:29 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: osdmap e232: 8 total, 8 up, 8 in 2024-09-11T08:23:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: osdmap e233: 8 total, 8 up, 8 in 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: osdmap e232: 8 total, 8 up, 8 in 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: osdmap e233: 8 total, 8 up, 8 in 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: osdmap e232: 8 total, 8 up, 8 in 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi173-80353-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: osdmap e233: 8 total, 8 up, 8 in 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]: dispatch 2024-09-11T08:23:31.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: pgmap v323: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]': finished 2024-09-11T08:23:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: osdmap e234: 8 total, 8 up, 8 in 2024-09-11T08:23:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: pgmap v323: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]': finished 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: osdmap e234: 8 total, 8 up, 8 in 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: pgmap v323: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-31", "mode": "writeback"}]': finished 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: osdmap e234: 8 total, 8 up, 8 in 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/68039343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]: dispatch 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: osdmap e235: 8 total, 8 up, 8 in 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:33.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:33 smithi175 ceph-mon[32813]: pgmap v326: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:33.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: osdmap e235: 8 total, 8 up, 8 in 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[29664]: pgmap v326: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi173-80342-38"}]': finished 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: osdmap e235: 8 total, 8 up, 8 in 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:33 smithi173 ceph-mon[40835]: pgmap v326: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:35.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: osdmap e236: 8 total, 8 up, 8 in 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: osdmap e236: 8 total, 8 up, 8 in 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-31"}]': finished 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi173-80342-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: osdmap e236: 8 total, 8 up, 8 in 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2487853058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:35.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]: dispatch 2024-09-11T08:23:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:36.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: osdmap e237: 8 total, 8 up, 8 in 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: pgmap v329: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:36.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: osdmap e238: 8 total, 8 up, 8 in 2024-09-11T08:23:36.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:36.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: osdmap e237: 8 total, 8 up, 8 in 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: pgmap v329: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: osdmap e238: 8 total, 8 up, 8 in 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:36.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi173-80353-48"}]': finished 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: osdmap e237: 8 total, 8 up, 8 in 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: pgmap v329: 196 pgs: 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi173-80342-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi173-80353-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:36.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: osdmap e238: 8 total, 8 up, 8 in 2024-09-11T08:23:36.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:36.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:36.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:37.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:37] "GET /metrics HTTP/1.1" 200 226062 "" "Prometheus/2.43.0" 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: osdmap e239: 8 total, 8 up, 8 in 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: pgmap v332: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: osdmap e240: 8 total, 8 up, 8 in 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: osdmap e239: 8 total, 8 up, 8 in 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: pgmap v332: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: osdmap e240: 8 total, 8 up, 8 in 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:37.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: osdmap e239: 8 total, 8 up, 8 in 2024-09-11T08:23:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: pgmap v332: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi173-80353-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: osdmap e240: 8 total, 8 up, 8 in 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:38.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: osdmap e241: 8 total, 8 up, 8 in 2024-09-11T08:23:39.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:39.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:39.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: osdmap e241: 8 total, 8 up, 8 in 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: osdmap e241: 8 total, 8 up, 8 in 2024-09-11T08:23:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:39.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]: dispatch 2024-09-11T08:23:39.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]: dispatch 2024-09-11T08:23:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: pgmap v335: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]': finished 2024-09-11T08:23:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: osdmap e242: 8 total, 8 up, 8 in 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:40.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:40.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: pgmap v335: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:40.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]': finished 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: osdmap e242: 8 total, 8 up, 8 in 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:40.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: pgmap v335: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:40.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2333846412' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi173-80342-39"}]': finished 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-33", "mode": "writeback"}]': finished 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: osdmap e242: 8 total, 8 up, 8 in 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:40.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:40.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:40.220 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: osdmap e243: 8 total, 8 up, 8 in 2024-09-11T08:23:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:41 smithi175 ceph-mon[32813]: pgmap v338: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:23:41.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: osdmap e243: 8 total, 8 up, 8 in 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[40835]: pgmap v338: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi173-80342-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: osdmap e243: 8 total, 8 up, 8 in 2024-09-11T08:23:41.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/698029801' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]: dispatch 2024-09-11T08:23:41.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:41 smithi173 ceph-mon[29664]: pgmap v338: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:23:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: osdmap e244: 8 total, 8 up, 8 in 2024-09-11T08:23:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:42.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: osdmap e244: 8 total, 8 up, 8 in 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi173-80353-49"}]': finished 2024-09-11T08:23:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-33"}]': finished 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: osdmap e244: 8 total, 8 up, 8 in 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:42.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: osdmap e245: 8 total, 8 up, 8 in 2024-09-11T08:23:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:43 smithi175 ceph-mon[32813]: pgmap v341: 204 pgs: 8 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: osdmap e245: 8 total, 8 up, 8 in 2024-09-11T08:23:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[29664]: pgmap v341: 204 pgs: 8 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi173-80342-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi173-80353-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: osdmap e245: 8 total, 8 up, 8 in 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:43 smithi173 ceph-mon[40835]: pgmap v341: 204 pgs: 8 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:23:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: osdmap e246: 8 total, 8 up, 8 in 2024-09-11T08:23:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: osdmap e247: 8 total, 8 up, 8 in 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: osdmap e246: 8 total, 8 up, 8 in 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: osdmap e247: 8 total, 8 up, 8 in 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: osdmap e246: 8 total, 8 up, 8 in 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi173-80353-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:45.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:45.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: osdmap e247: 8 total, 8 up, 8 in 2024-09-11T08:23:45.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:45.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:46.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: pgmap v344: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: osdmap e248: 8 total, 8 up, 8 in 2024-09-11T08:23:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: pgmap v344: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: osdmap e248: 8 total, 8 up, 8 in 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: pgmap v344: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: osdmap e248: 8 total, 8 up, 8 in 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3250326694' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]: dispatch 2024-09-11T08:23:46.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: osdmap e249: 8 total, 8 up, 8 in 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: osdmap e249: 8 total, 8 up, 8 in 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi173-80342-40"}]': finished 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: osdmap e249: 8 total, 8 up, 8 in 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:47.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:47.789 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:47] "GET /metrics HTTP/1.1" 200 226062 "" "Prometheus/2.43.0" 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: pgmap v347: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]': finished 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: osdmap e250: 8 total, 8 up, 8 in 2024-09-11T08:23:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:48.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:48.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:48.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: pgmap v347: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]': finished 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: osdmap e250: 8 total, 8 up, 8 in 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:48.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: pgmap v347: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-35", "mode": "writeback"}]': finished 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi173-80342-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: osdmap e250: 8 total, 8 up, 8 in 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/887446344' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:48.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]: dispatch 2024-09-11T08:23:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:49 smithi175 ceph-mon[32813]: osdmap e251: 8 total, 8 up, 8 in 2024-09-11T08:23:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:49 smithi175 ceph-mon[32813]: pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:49 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[29664]: osdmap e251: 8 total, 8 up, 8 in 2024-09-11T08:23:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[29664]: pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi173-80353-50"}]': finished 2024-09-11T08:23:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[40835]: osdmap e251: 8 total, 8 up, 8 in 2024-09-11T08:23:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[40835]: pgmap v350: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:23:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:49 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: osdmap e252: 8 total, 8 up, 8 in 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: osdmap e252: 8 total, 8 up, 8 in 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi173-80342-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: osdmap e252: 8 total, 8 up, 8 in 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:23:50.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:23:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: osdmap e253: 8 total, 8 up, 8 in 2024-09-11T08:23:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:51 smithi175 ceph-mon[32813]: pgmap v353: 268 pgs: 268 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-11T08:23:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: osdmap e253: 8 total, 8 up, 8 in 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[29664]: pgmap v353: 268 pgs: 268 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2315681969' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi173-80353-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: osdmap e253: 8 total, 8 up, 8 in 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:51 smithi173 ceph-mon[40835]: pgmap v353: 268 pgs: 268 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-11T08:23:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: osdmap e254: 8 total, 8 up, 8 in 2024-09-11T08:23:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: osdmap e254: 8 total, 8 up, 8 in 2024-09-11T08:23:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: osdmap e254: 8 total, 8 up, 8 in 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:52.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:52.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:53.803 INFO:tasks.workunit.client.0.smithi173.stdout:te 2024-09-11T08:23:53.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6927 ms) 2024-09-11T08:23:53.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-09-11T08:23:53.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7020 ms) 2024-09-11T08:23:53.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7000 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7056 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7035 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7044 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7061 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6805 ms) 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-09-11T08:23:53.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7034 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6964 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7034 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6967 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7019 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7017 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7270 ms) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112051 ms total) 2024-09-11T08:23:53.805 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: 2024-09-11T08:23:53.806 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [----------] Global test environment tear-down 2024-09-11T08:23:53.806 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [==========] 41 tests from 2 test suites ran. (195477 ms total) 2024-09-11T08:23:53.806 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio: [ PASSED ] 41 tests. 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: osdmap e255: 8 total, 8 up, 8 in 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:53 smithi175 ceph-mon[32813]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:23:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: osdmap e255: 8 total, 8 up, 8 in 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[29664]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: osdmap e255: 8 total, 8 up, 8 in 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]: dispatch 2024-09-11T08:23:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:23:54.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:53 smithi173 ceph-mon[40835]: pgmap v356: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:23:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: osdmap e256: 8 total, 8 up, 8 in 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:54 smithi175 ceph-mon[32813]: osdmap e257: 8 total, 8 up, 8 in 2024-09-11T08:23:55.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:55.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: osdmap e256: 8 total, 8 up, 8 in 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[29664]: osdmap e257: 8 total, 8 up, 8 in 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1269595920' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi173-80342-41"}]': finished 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: osdmap e256: 8 total, 8 up, 8 in 2024-09-11T08:23:55.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]: dispatch 2024-09-11T08:23:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:23:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi173-80353-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-35"}]': finished 2024-09-11T08:23:55.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:54 smithi173 ceph-mon[40835]: osdmap e257: 8 total, 8 up, 8 in 2024-09-11T08:23:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:23:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:23:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:55 smithi175 ceph-mon[32813]: pgmap v359: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:55 smithi175 ceph-mon[32813]: osdmap e258: 8 total, 8 up, 8 in 2024-09-11T08:23:56.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:23:56.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:55 smithi173 ceph-mon[29664]: pgmap v359: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:56.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:55 smithi173 ceph-mon[29664]: osdmap e258: 8 total, 8 up, 8 in 2024-09-11T08:23:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:55 smithi173 ceph-mon[40835]: pgmap v359: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:23:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:55 smithi173 ceph-mon[40835]: osdmap e258: 8 total, 8 up, 8 in 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: osdmap e259: 8 total, 8 up, 8 in 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: osdmap e259: 8 total, 8 up, 8 in 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: osdmap e259: 8 total, 8 up, 8 in 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:23:57.823 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:23:57] "GET /metrics HTTP/1.1" 200 233344 "" "Prometheus/2.43.0" 2024-09-11T08:23:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: pgmap v362: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: osdmap e260: 8 total, 8 up, 8 in 2024-09-11T08:23:58.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:58.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: pgmap v362: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: osdmap e260: 8 total, 8 up, 8 in 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: pgmap v362: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: osdmap e260: 8 total, 8 up, 8 in 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/620519197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]: dispatch 2024-09-11T08:23:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:23:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: osdmap e261: 8 total, 8 up, 8 in 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: pgmap v365: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: osdmap e262: 8 total, 8 up, 8 in 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:23:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: osdmap e261: 8 total, 8 up, 8 in 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: pgmap v365: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: osdmap e262: 8 total, 8 up, 8 in 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi173-80353-52"}]': finished 2024-09-11T08:23:59.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: osdmap e261: 8 total, 8 up, 8 in 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: pgmap v365: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:23:59.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: osdmap e262: 8 total, 8 up, 8 in 2024-09-11T08:23:59.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]: dispatch 2024-09-11T08:23:59.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:23:59.970 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:23:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:01.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:00 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:00 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:01.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:00 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]': finished 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: osdmap e263: 8 total, 8 up, 8 in 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: pgmap v368: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: osdmap e264: 8 total, 8 up, 8 in 2024-09-11T08:24:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:01 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:24:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]': finished 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: osdmap e263: 8 total, 8 up, 8 in 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: pgmap v368: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: osdmap e264: 8 total, 8 up, 8 in 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-37", "mode": "writeback"}]': finished 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: osdmap e263: 8 total, 8 up, 8 in 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: pgmap v368: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi173-80353-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: osdmap e264: 8 total, 8 up, 8 in 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]: dispatch 2024-09-11T08:24:02.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:01 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:24:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:24:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:24:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:24:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:03 smithi175 ceph-mon[32813]: osdmap e265: 8 total, 8 up, 8 in 2024-09-11T08:24:03.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[29664]: osdmap e265: 8 total, 8 up, 8 in 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-37"}]': finished 2024-09-11T08:24:03.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:03 smithi173 ceph-mon[40835]: osdmap e265: 8 total, 8 up, 8 in 2024-09-11T08:24:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:04 smithi175 ceph-mon[32813]: pgmap v371: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:04 smithi175 ceph-mon[32813]: osdmap e266: 8 total, 8 up, 8 in 2024-09-11T08:24:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:04.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[29664]: pgmap v371: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:04.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[29664]: osdmap e266: 8 total, 8 up, 8 in 2024-09-11T08:24:04.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:04.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[40835]: pgmap v371: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[40835]: osdmap e266: 8 total, 8 up, 8 in 2024-09-11T08:24:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:04.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: osdmap e267: 8 total, 8 up, 8 in 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:05.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: osdmap e267: 8 total, 8 up, 8 in 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:05.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: osdmap e267: 8 total, 8 up, 8 in 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4268686747' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]: dispatch 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:24:05.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:06.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: pgmap v374: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: osdmap e268: 8 total, 8 up, 8 in 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:06.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:06.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: pgmap v374: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: osdmap e268: 8 total, 8 up, 8 in 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:06.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: pgmap v374: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi173-80353-53"}]': finished 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: osdmap e268: 8 total, 8 up, 8 in 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:06.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:06.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: osdmap e269: 8 total, 8 up, 8 in 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:07.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:07.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: osdmap e269: 8 total, 8 up, 8 in 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi173-80353-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: osdmap e269: 8 total, 8 up, 8 in 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:07] "GET /metrics HTTP/1.1" 200 228489 "" "Prometheus/2.43.0" 2024-09-11T08:24:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:08 smithi175 ceph-mon[32813]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:08 smithi175 ceph-mon[32813]: osdmap e270: 8 total, 8 up, 8 in 2024-09-11T08:24:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[29664]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[29664]: osdmap e270: 8 total, 8 up, 8 in 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[40835]: pgmap v377: 228 pgs: 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[40835]: osdmap e270: 8 total, 8 up, 8 in 2024-09-11T08:24:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]: dispatch 2024-09-11T08:24:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]': finished 2024-09-11T08:24:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: osdmap e271: 8 total, 8 up, 8 in 2024-09-11T08:24:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:09.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:09.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:09.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:09.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]': finished 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: osdmap e271: 8 total, 8 up, 8 in 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi173-80353-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-39", "mode": "writeback"}]': finished 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: osdmap e271: 8 total, 8 up, 8 in 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:09.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: pgmap v380: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: osdmap e272: 8 total, 8 up, 8 in 2024-09-11T08:24:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:10.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:10.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: pgmap v380: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:10.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: osdmap e272: 8 total, 8 up, 8 in 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: pgmap v380: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: osdmap e272: 8 total, 8 up, 8 in 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]: dispatch 2024-09-11T08:24:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:11 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:11 smithi175 ceph-mon[32813]: osdmap e273: 8 total, 8 up, 8 in 2024-09-11T08:24:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:11.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:11.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[29664]: osdmap e273: 8 total, 8 up, 8 in 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-39"}]': finished 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[40835]: osdmap e273: 8 total, 8 up, 8 in 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:11.524 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-09-11T08:24:11.524 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: seed 80673 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (264 ms) 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (10918 ms) 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (5 ms) 2024-09-11T08:24:11.525 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (11187 ms total) 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7119 ms) 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7876 ms) 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9985 ms) 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: my_snaps [4] 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: my_snaps [5,4] 2024-09-11T08:24:11.526 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: my_snaps [6,5,4] 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: my_snaps [7,6,5,4] 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: promoting some heads 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: promoting from clones for snap 7 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: promoting from clones for snap 6 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: promoting from clones for snap 5 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: promoting from clones for snap 4 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: waiting for scrubs... 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: done waiting 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46256 ms) 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9776 ms) 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T08:24:11.527 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7998 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8063 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8040 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10070 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8835 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10276 ms) 2024-09-11T08:24:11.528 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12757 ms) 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8211 ms) 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7785 ms) 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13045 ms) 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7940 ms) 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T08:24:11.529 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8016 ms) 2024-09-11T08:24:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:12 smithi175 ceph-mon[32813]: pgmap v383: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 82 op/s 2024-09-11T08:24:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:12 smithi175 ceph-mon[32813]: osdmap e274: 8 total, 8 up, 8 in 2024-09-11T08:24:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:12.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:12.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[29664]: pgmap v383: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 82 op/s 2024-09-11T08:24:12.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:12.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[29664]: osdmap e274: 8 total, 8 up, 8 in 2024-09-11T08:24:12.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[40835]: pgmap v383: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 82 op/s 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[40835]: osdmap e274: 8 total, 8 up, 8 in 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2468849072' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:12.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]: dispatch 2024-09-11T08:24:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: osdmap e275: 8 total, 8 up, 8 in 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:13 smithi175 ceph-mon[32813]: pgmap v386: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:24:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: osdmap e275: 8 total, 8 up, 8 in 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[29664]: pgmap v386: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi173-80353-54"}]': finished 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: osdmap e275: 8 total, 8 up, 8 in 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:13.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:13 smithi173 ceph-mon[40835]: pgmap v386: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:24:15.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:15.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: osdmap e276: 8 total, 8 up, 8 in 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:14 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: osdmap e276: 8 total, 8 up, 8 in 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi173-80353-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: osdmap e276: 8 total, 8 up, 8 in 2024-09-11T08:24:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:15.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:14 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:16.030 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:16.030 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: osdmap e277: 8 total, 8 up, 8 in 2024-09-11T08:24:16.030 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.030 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: osdmap e278: 8 total, 8 up, 8 in 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.031 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: osdmap e277: 8 total, 8 up, 8 in 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: osdmap e278: 8 total, 8 up, 8 in 2024-09-11T08:24:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: osdmap e277: 8 total, 8 up, 8 in 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi173-80353-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: osdmap e278: 8 total, 8 up, 8 in 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:16.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-mon[32813]: osdmap e279: 8 total, 8 up, 8 in 2024-09-11T08:24:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[29664]: osdmap e279: 8 total, 8 up, 8 in 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[40835]: osdmap e279: 8 total, 8 up, 8 in 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:24:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:17] "GET /metrics HTTP/1.1" 200 228489 "" "Prometheus/2.43.0" 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[29664]: pgmap v392: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[29664]: osdmap e280: 8 total, 8 up, 8 in 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[40835]: pgmap v392: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:24:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[40835]: osdmap e280: 8 total, 8 up, 8 in 2024-09-11T08:24:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:17.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:17 smithi175 ceph-mon[32813]: pgmap v392: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:24:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:17 smithi175 ceph-mon[32813]: osdmap e280: 8 total, 8 up, 8 in 2024-09-11T08:24:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: osdmap e281: 8 total, 8 up, 8 in 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:19 smithi175 ceph-mon[32813]: pgmap v395: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: osdmap e281: 8 total, 8 up, 8 in 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[29664]: pgmap v395: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: osdmap e281: 8 total, 8 up, 8 in 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1680167772' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]: dispatch 2024-09-11T08:24:19.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:19 smithi173 ceph-mon[40835]: pgmap v395: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]': finished 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: osdmap e282: 8 total, 8 up, 8 in 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:20.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]': finished 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: osdmap e282: 8 total, 8 up, 8 in 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi173-80353-55"}]': finished 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-41"}]': finished 2024-09-11T08:24:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: osdmap e282: 8 total, 8 up, 8 in 2024-09-11T08:24:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:20.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:21 smithi175 ceph-mon[32813]: osdmap e283: 8 total, 8 up, 8 in 2024-09-11T08:24:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:21 smithi175 ceph-mon[32813]: pgmap v398: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[29664]: osdmap e283: 8 total, 8 up, 8 in 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[29664]: pgmap v398: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi173-80353-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[40835]: osdmap e283: 8 total, 8 up, 8 in 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:21 smithi173 ceph-mon[40835]: pgmap v398: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:22 smithi175 ceph-mon[32813]: osdmap e284: 8 total, 8 up, 8 in 2024-09-11T08:24:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[29664]: osdmap e284: 8 total, 8 up, 8 in 2024-09-11T08:24:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[40835]: osdmap e284: 8 total, 8 up, 8 in 2024-09-11T08:24:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:22.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: osdmap e285: 8 total, 8 up, 8 in 2024-09-11T08:24:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-6","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:23 smithi175 ceph-mon[32813]: pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: osdmap e285: 8 total, 8 up, 8 in 2024-09-11T08:24:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-6","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[29664]: pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi173-80353-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: osdmap e285: 8 total, 8 up, 8 in 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-6","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:23 smithi173 ceph-mon[40835]: pgmap v401: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:24 smithi175 ceph-mon[32813]: osdmap e286: 8 total, 8 up, 8 in 2024-09-11T08:24:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:24.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:24.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[29664]: osdmap e286: 8 total, 8 up, 8 in 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[40835]: osdmap e286: 8 total, 8 up, 8 in 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:24.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]: dispatch 2024-09-11T08:24:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]': finished 2024-09-11T08:24:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: osdmap e287: 8 total, 8 up, 8 in 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: pgmap v404: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: osdmap e288: 8 total, 8 up, 8 in 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:25.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]': finished 2024-09-11T08:24:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: osdmap e287: 8 total, 8 up, 8 in 2024-09-11T08:24:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: pgmap v404: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: osdmap e288: 8 total, 8 up, 8 in 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_count","val": "8"}]': finished 2024-09-11T08:24:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: osdmap e287: 8 total, 8 up, 8 in 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: pgmap v404: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: osdmap e288: 8 total, 8 up, 8 in 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]: dispatch 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:25.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-09-11T08:24:26.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:26.788 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: ok, hit_set contains 192:602f83fe:::foo:head 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9028 ms) 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg_num = 32 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 0 ls 1726043067,0 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 1 ls 1726043067,0 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 2 ls 1726043067,0 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 3 ls 1726043067,0 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 4 ls 1726043067,0 2024-09-11T08:24:26.789 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 5 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 6 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 7 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 8 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 9 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 10 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 11 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 12 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 13 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 14 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 15 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 16 ls 1726043067,0 2024-09-11T08:24:26.790 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 17 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 18 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 19 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 20 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 21 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 22 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 23 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 24 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 25 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 26 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 27 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 28 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 29 ls 1726043067,0 2024-09-11T08:24:26.791 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 30 ls 1726043067,0 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg 31 ls 1726043067,0 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: pg_num = 32 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6cac518f:::0:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:02547ec2:::1:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f905c69b:::2:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:cfc208b3:::3:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d83876eb:::4:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b29083e3:::5:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c4fdafeb:::6:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:5c6b0b28:::7:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:bd63b0f1:::8:head 2024-09-11T08:24:26.792 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e960b815:::9:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:52ea6a34:::10:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:89d3ae78:::11:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:de5d7c5f:::12:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:566253c9:::13:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:62a1935d:::14:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:863748b0:::15:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3958e169:::16:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4d4dabf9:::17:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:8391935d:::18:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:28883081:::19:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:69259c59:::20:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4bdb80b7:::21:head 2024-09-11T08:24:26.793 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a11c5d71:::22:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:271af37b:::23:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:95b121be:::24:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:58d1031b:::25:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:0a050783:::26:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c709704c:::27:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:cbe56eaf:::28:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:86b4b162:::29:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:70d89383:::30:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:dd450c7c:::31:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6d5729b1:::32:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c388f3fb:::33:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:56cfea31:::34:head 2024-09-11T08:24:26.794 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9dbc1bf7:::35:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:40b74ccd:::36:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4d5aaf42:::37:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:920f362c:::38:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6cc53222:::39:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9cad833f:::40:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:1ea84d41:::41:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c4480ef6:::42:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a694361e:::43:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d1bd33e9:::44:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ddc2cd5d:::45:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:2b782207:::46:head 2024-09-11T08:24:26.795 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7b187fca:::47:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:90ecdf6f:::48:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a5ed95fe:::49:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ea0eaa55:::50:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f33ef17b:::51:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a0d1b2f6:::52:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:60c5229e:::53:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:edcbc575:::54:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:102cf253:::55:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:efb7fb0b:::56:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:50d0a326:::57:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d4dc5daf:::58:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3a130462:::59:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ec87ed71:::60:head 2024-09-11T08:24:26.796 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d5bc9454:::61:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3ddfe313:::62:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7c2816b9:::63:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:47e00e4d:::64:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c6410c18:::65:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b48ed237:::66:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:cd63ad31:::67:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b179e92b:::68:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:0d9f741a:::69:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6d3352ae:::70:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c6d5c19e:::71:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:bc4729c3:::72:head 2024-09-11T08:24:26.797 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:77e930b9:::73:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:0abeecfd:::74:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b7c37e15:::75:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b6378398:::76:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:02bd68de:::77:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:cc795d2d:::78:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:630d4fea:::79:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e0d29ef5:::80:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:fd6f13d2:::81:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:606461d5:::82:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:eadbdc43:::83:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:8761d0bb:::84:head 2024-09-11T08:24:26.798 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9ef0186f:::85:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e0d41294:::86:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:961de695:::87:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:1423148f:::88:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:633a8fa2:::89:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a8653809:::90:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3dac8b33:::91:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:35aad435:::92:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f6dcc343:::93:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:dbbdad87:::94:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:1cb48ce0:::95:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:03cd461c:::96:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:17a4ea99:::97:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9993c9a7:::98:head 2024-09-11T08:24:26.799 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6394211c:::99:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:94c7ae57:::100:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6fdee5bb:::101:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9a477fd1:::102:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:eb850916:::103:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:affc56b9:::104:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b42dc814:::105:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f319f8f0:::106:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9a40b9de:::107:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:8b524f28:::108:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e3de589f:::109:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:90f90a5b:::110:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a7b4f1d7:::111:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:af51766e:::112:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b6f90bd1:::113:head 2024-09-11T08:24:26.800 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e0261208:::114:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c9569ef7:::115:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:61bebe50:::116:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:fe93412b:::117:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d3d38bee:::118:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3100ba0c:::119:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d0560ada:::120:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f0ea8b35:::121:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:766f231a:::122:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a07a2582:::123:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:bd7c6b3a:::124:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:fb2ddaff:::125:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4408e1fe:::126:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ee1df7a7:::127:head 2024-09-11T08:24:26.801 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c3002909:::128:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4f48ffa9:::129:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:edf38733:::130:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c08425c0:::131:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:5f902d98:::132:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:41ea2c93:::133:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:813cee13:::134:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:0131818d:::135:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:26ba5a85:::136:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:381b8a5a:::137:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:28797e47:::138:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:bfca7f22:::139:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:36807075:::140:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:80b03975:::141:head 2024-09-11T08:24:26.802 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:5c15709b:::142:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f39ea15e:::143:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ea992956:::144:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:48887b1c:::145:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:9f24a9dd:::146:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:987f100b:::147:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d2dd3581:::148:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7fed1808:::149:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c80b70e9:::150:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:85ed90f9:::151:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:36428b24:::152:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d044c34a:::153:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7c18bf58:::154:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d1c21232:::155:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a7a3c575:::156:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:87da0633:::157:head 2024-09-11T08:24:26.803 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d5ac3822:::158:head 2024-09-11T08:24:26.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3f20522d:::159:head 2024-09-11T08:24:26.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6ca26563:::160:head 2024-09-11T08:24:26.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:532ce135:::161:head 2024-09-11T08:24:26.804 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:c78863e6:::162:head 2024-09-11T08:24:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-11T08:24:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:26 smithi175 ceph-mon[32813]: osdmap e289: 8 total, 8 up, 8 in 2024-09-11T08:24:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[29664]: osdmap e289: 8 total, 8 up, 8 in 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1731929835' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi173-80353-56"}]': finished 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-09-11T08:24:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:26 smithi173 ceph-mon[40835]: osdmap e289: 8 total, 8 up, 8 in 2024-09-11T08:24:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-43","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:27 smithi175 ceph-mon[32813]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:27] "GET /metrics HTTP/1.1" 200 228497 "" "Prometheus/2.43.0" 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-43","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[29664]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi173-80673-43","var": "pg_num","format": "json"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]: dispatch 2024-09-11T08:24:27.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:27 smithi173 ceph-mon[40835]: pgmap v407: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]': finished 2024-09-11T08:24:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:28 smithi175 ceph-mon[32813]: osdmap e290: 8 total, 8 up, 8 in 2024-09-11T08:24:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:29.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:29.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]': finished 2024-09-11T08:24:29.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[29664]: osdmap e290: 8 total, 8 up, 8 in 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi173-80353-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-43"}]': finished 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[40835]: osdmap e290: 8 total, 8 up, 8 in 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:29.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: osdmap e291: 8 total, 8 up, 8 in 2024-09-11T08:24:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: pgmap v410: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: osdmap e292: 8 total, 8 up, 8 in 2024-09-11T08:24:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:30.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: osdmap e291: 8 total, 8 up, 8 in 2024-09-11T08:24:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: pgmap v410: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: osdmap e292: 8 total, 8 up, 8 in 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: osdmap e291: 8 total, 8 up, 8 in 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: pgmap v410: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi173-80353-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: osdmap e292: 8 total, 8 up, 8 in 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[29664]: osdmap e293: 8 total, 8 up, 8 in 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[29664]: pgmap v413: 236 pgs: 236 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:31.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[40835]: osdmap e293: 8 total, 8 up, 8 in 2024-09-11T08:24:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:31.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:31 smithi173 ceph-mon[40835]: pgmap v413: 236 pgs: 236 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:24:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:31 smithi175 ceph-mon[32813]: osdmap e293: 8 total, 8 up, 8 in 2024-09-11T08:24:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:31 smithi175 ceph-mon[32813]: pgmap v413: 236 pgs: 236 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:24:32.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: osdmap e294: 8 total, 8 up, 8 in 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: osdmap e294: 8 total, 8 up, 8 in 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:32.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:32.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:32.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: osdmap e294: 8 total, 8 up, 8 in 2024-09-11T08:24:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:24:33.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:24:33.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: osdmap e295: 8 total, 8 up, 8 in 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: pgmap v416: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: osdmap e296: 8 total, 8 up, 8 in 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: osdmap e295: 8 total, 8 up, 8 in 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: pgmap v416: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: osdmap e296: 8 total, 8 up, 8 in 2024-09-11T08:24:33.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:33.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:24:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: osdmap e295: 8 total, 8 up, 8 in 2024-09-11T08:24:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/556953987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]: dispatch 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: pgmap v416: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi173-80353-57"}]': finished 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: osdmap e296: 8 total, 8 up, 8 in 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:34.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: osdmap e297: 8 total, 8 up, 8 in 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:34.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: osdmap e297: 8 total, 8 up, 8 in 2024-09-11T08:24:34.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:34.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:34.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:34.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi173-80353-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: osdmap e297: 8 total, 8 up, 8 in 2024-09-11T08:24:35.078 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:35.079 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:24:35.079 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.079 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:36.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:35 smithi173 ceph-mon[40835]: pgmap v419: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:36.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:35 smithi173 ceph-mon[29664]: pgmap v419: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:36.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:36.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:36.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:35 smithi175 ceph-mon[32813]: pgmap v419: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[29664]: osdmap e298: 8 total, 8 up, 8 in 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[29664]: osdmap e299: 8 total, 8 up, 8 in 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[40835]: osdmap e298: 8 total, 8 up, 8 in 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:36 smithi173 ceph-mon[40835]: osdmap e299: 8 total, 8 up, 8 in 2024-09-11T08:24:37.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:24:37.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-mon[32813]: osdmap e298: 8 total, 8 up, 8 in 2024-09-11T08:24:37.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:37.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi173-80353-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:37.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:36 smithi175 ceph-mon[32813]: osdmap e299: 8 total, 8 up, 8 in 2024-09-11T08:24:37.871 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:37] "GET /metrics HTTP/1.1" 200 228510 "" "Prometheus/2.43.0" 2024-09-11T08:24:38.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:37 smithi173 ceph-mon[29664]: pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:38.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:37 smithi173 ceph-mon[29664]: osdmap e300: 8 total, 8 up, 8 in 2024-09-11T08:24:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:37 smithi173 ceph-mon[40835]: pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:37 smithi173 ceph-mon[40835]: osdmap e300: 8 total, 8 up, 8 in 2024-09-11T08:24:38.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:37 smithi175 ceph-mon[32813]: pgmap v422: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:38.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:37 smithi175 ceph-mon[32813]: osdmap e300: 8 total, 8 up, 8 in 2024-09-11T08:24:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[29664]: osdmap e301: 8 total, 8 up, 8 in 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[40835]: osdmap e301: 8 total, 8 up, 8 in 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:38 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:38 smithi175 ceph-mon[32813]: osdmap e301: 8 total, 8 up, 8 in 2024-09-11T08:24:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:39.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[29664]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[29664]: osdmap e302: 8 total, 8 up, 8 in 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[40835]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[40835]: osdmap e302: 8 total, 8 up, 8 in 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:39 smithi175 ceph-mon[32813]: pgmap v425: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:39 smithi175 ceph-mon[32813]: osdmap e302: 8 total, 8 up, 8 in 2024-09-11T08:24:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2958776002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:40.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]: dispatch 2024-09-11T08:24:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: osdmap e303: 8 total, 8 up, 8 in 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[29664]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: osdmap e303: 8 total, 8 up, 8 in 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:41.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:41 smithi173 ceph-mon[40835]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi173-80353-58"}]': finished 2024-09-11T08:24:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: osdmap e303: 8 total, 8 up, 8 in 2024-09-11T08:24:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:42.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:42.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:42.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:42.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:41 smithi175 ceph-mon[32813]: pgmap v428: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[29664]: osdmap e304: 8 total, 8 up, 8 in 2024-09-11T08:24:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:43.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[40835]: osdmap e304: 8 total, 8 up, 8 in 2024-09-11T08:24:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:43.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:43.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:42 smithi175 ceph-mon[32813]: osdmap e304: 8 total, 8 up, 8 in 2024-09-11T08:24:43.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:43.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[29664]: osdmap e305: 8 total, 8 up, 8 in 2024-09-11T08:24:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[29664]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[29664]: osdmap e306: 8 total, 8 up, 8 in 2024-09-11T08:24:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[40835]: osdmap e305: 8 total, 8 up, 8 in 2024-09-11T08:24:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[40835]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:43 smithi173 ceph-mon[40835]: osdmap e306: 8 total, 8 up, 8 in 2024-09-11T08:24:44.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:43 smithi175 ceph-mon[32813]: osdmap e305: 8 total, 8 up, 8 in 2024-09-11T08:24:44.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:43 smithi175 ceph-mon[32813]: pgmap v431: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:24:44.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi173-80353-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:44.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:43 smithi175 ceph-mon[32813]: osdmap e306: 8 total, 8 up, 8 in 2024-09-11T08:24:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:44 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:44 smithi173 ceph-mon[29664]: osdmap e307: 8 total, 8 up, 8 in 2024-09-11T08:24:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:44 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:44 smithi173 ceph-mon[40835]: osdmap e307: 8 total, 8 up, 8 in 2024-09-11T08:24:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:44 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:44 smithi175 ceph-mon[32813]: osdmap e307: 8 total, 8 up, 8 in 2024-09-11T08:24:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[29664]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[29664]: osdmap e308: 8 total, 8 up, 8 in 2024-09-11T08:24:46.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:46.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[40835]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[40835]: osdmap e308: 8 total, 8 up, 8 in 2024-09-11T08:24:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:46.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:46.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:45 smithi175 ceph-mon[32813]: pgmap v434: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:45 smithi175 ceph-mon[32813]: osdmap e308: 8 total, 8 up, 8 in 2024-09-11T08:24:46.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:46.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[29664]: osdmap e309: 8 total, 8 up, 8 in 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[40835]: osdmap e309: 8 total, 8 up, 8 in 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-mon[32813]: osdmap e309: 8 total, 8 up, 8 in 2024-09-11T08:24:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1563647503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]: dispatch 2024-09-11T08:24:47.643 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7462ddf6:::16.RoundTripAppendPP (3221 ms) 2024-09-11T08:24:47.643 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-09-11T08:24:47.643 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2774 ms) 2024-09-11T08:24:47.643 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-11T08:24:47.643 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3008 ms) 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3021 ms) 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: setting pool EIO 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: max_success 1716, min_failed 1717 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4049 ms) 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3001 ms) 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (122242 ms total) 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-11T08:24:47.644 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3020 ms) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9297 ms) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14618 ms) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3015 ms) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29950 ms total) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3254 ms) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3254 ms total) 2024-09-11T08:24:47.645 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14009 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6963 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6779 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7252 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (2790 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7010 ms) 2024-09-11T08:24:47.646 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6948 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7012 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7012 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7035 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7032 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7015 ms) 2024-09-11T08:24:47.647 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T08:24:47.648 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7015 ms) 2024-09-11T08:24:47.903 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:47] "GET /metrics HTTP/1.1" 200 228510 "" "Prometheus/2.43.0" 2024-09-11T08:24:48.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[29664]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:48.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:48.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[29664]: osdmap e310: 8 total, 8 up, 8 in 2024-09-11T08:24:48.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[40835]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:48.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:47 smithi173 ceph-mon[40835]: osdmap e310: 8 total, 8 up, 8 in 2024-09-11T08:24:48.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:47 smithi175 ceph-mon[32813]: pgmap v437: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:48.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi173-80353-59"}]': finished 2024-09-11T08:24:48.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:47 smithi175 ceph-mon[32813]: osdmap e310: 8 total, 8 up, 8 in 2024-09-11T08:24:49.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]': finished 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: osdmap e311: 8 total, 8 up, 8 in 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]': finished 2024-09-11T08:24:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: osdmap e311: 8 total, 8 up, 8 in 2024-09-11T08:24:49.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]: dispatch 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-45"}]': finished 2024-09-11T08:24:49.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: osdmap e311: 8 total, 8 up, 8 in 2024-09-11T08:24:49.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:50.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[29664]: pgmap v440: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:50.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:50.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[29664]: osdmap e312: 8 total, 8 up, 8 in 2024-09-11T08:24:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[40835]: pgmap v440: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[40835]: osdmap e312: 8 total, 8 up, 8 in 2024-09-11T08:24:50.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:49 smithi175 ceph-mon[32813]: pgmap v440: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-11T08:24:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1186010485' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi173-80353-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:49 smithi175 ceph-mon[32813]: osdmap e312: 8 total, 8 up, 8 in 2024-09-11T08:24:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:24:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: osdmap e313: 8 total, 8 up, 8 in 2024-09-11T08:24:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: osdmap e313: 8 total, 8 up, 8 in 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:51.245 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: osdmap e313: 8 total, 8 up, 8 in 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:51.246 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: pgmap v443: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: osdmap e314: 8 total, 8 up, 8 in 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: pgmap v443: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: osdmap e314: 8 total, 8 up, 8 in 2024-09-11T08:24:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:52.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: pgmap v443: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:24:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi173-80353-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: osdmap e314: 8 total, 8 up, 8 in 2024-09-11T08:24:52.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:52.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:52.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:24:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[29664]: osdmap e315: 8 total, 8 up, 8 in 2024-09-11T08:24:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[29664]: pgmap v446: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[40835]: osdmap e315: 8 total, 8 up, 8 in 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:53 smithi173 ceph-mon[40835]: pgmap v446: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:24:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:53 smithi175 ceph-mon[32813]: osdmap e315: 8 total, 8 up, 8 in 2024-09-11T08:24:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:24:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:53 smithi175 ceph-mon[32813]: pgmap v446: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:24:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:24:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[29664]: osdmap e316: 8 total, 8 up, 8 in 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[40835]: osdmap e316: 8 total, 8 up, 8 in 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi173-80353-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:24:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:54 smithi175 ceph-mon[32813]: osdmap e316: 8 total, 8 up, 8 in 2024-09-11T08:24:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]: dispatch 2024-09-11T08:24:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:24:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]': finished 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: osdmap e317: 8 total, 8 up, 8 in 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: pgmap v449: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: osdmap e318: 8 total, 8 up, 8 in 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]': finished 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: osdmap e317: 8 total, 8 up, 8 in 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: pgmap v449: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: osdmap e318: 8 total, 8 up, 8 in 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-47", "mode": "writeback"}]': finished 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: osdmap e317: 8 total, 8 up, 8 in 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: pgmap v449: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: osdmap e318: 8 total, 8 up, 8 in 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:24:56.069 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:56.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:24:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: osdmap e319: 8 total, 8 up, 8 in 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: osdmap e319: 8 total, 8 up, 8 in 2024-09-11T08:24:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:56.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: osdmap e319: 8 total, 8 up, 8 in 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]: dispatch 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:24:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:24:57] "GET /metrics HTTP/1.1" 200 228530 "" "Prometheus/2.43.0" 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: osdmap e320: 8 total, 8 up, 8 in 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: osdmap e320: 8 total, 8 up, 8 in 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:57.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: pgmap v452: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3195017600' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi173-80353-61"}]': finished 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: osdmap e320: 8 total, 8 up, 8 in 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:24:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: osdmap e321: 8 total, 8 up, 8 in 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: osdmap e321: 8 total, 8 up, 8 in 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:58.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:24:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: osdmap e321: 8 total, 8 up, 8 in 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:24:59.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:25:00.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:24:59 smithi173 ceph-mon[29664]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:25:00.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:24:59 smithi173 ceph-mon[40835]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:25:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:24:59 smithi175 ceph-mon[32813]: pgmap v455: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:25:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:25:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: osdmap e322: 8 total, 8 up, 8 in 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: osdmap e323: 8 total, 8 up, 8 in 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: osdmap e322: 8 total, 8 up, 8 in 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:25:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: osdmap e323: 8 total, 8 up, 8 in 2024-09-11T08:25:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:01.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:25:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: osdmap e322: 8 total, 8 up, 8 in 2024-09-11T08:25:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi173-80353-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: osdmap e323: 8 total, 8 up, 8 in 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:01.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[29664]: pgmap v458: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[29664]: osdmap e324: 8 total, 8 up, 8 in 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[40835]: pgmap v458: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[40835]: osdmap e324: 8 total, 8 up, 8 in 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:01 smithi175 ceph-mon[32813]: pgmap v458: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:01 smithi175 ceph-mon[32813]: osdmap e324: 8 total, 8 up, 8 in 2024-09-11T08:25:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: osdmap e325: 8 total, 8 up, 8 in 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: osdmap e325: 8 total, 8 up, 8 in 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:25:03.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:25:03.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:02 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:25:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]': finished 2024-09-11T08:25:03.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: osdmap e325: 8 total, 8 up, 8 in 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-47"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:25:03.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:02 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[29664]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[29664]: osdmap e326: 8 total, 8 up, 8 in 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[40835]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[40835]: osdmap e326: 8 total, 8 up, 8 in 2024-09-11T08:25:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:03 smithi175 ceph-mon[32813]: pgmap v461: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:25:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:03 smithi175 ceph-mon[32813]: osdmap e326: 8 total, 8 up, 8 in 2024-09-11T08:25:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]: dispatch 2024-09-11T08:25:05.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:05.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: osdmap e327: 8 total, 8 up, 8 in 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[29664]: pgmap v464: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:05.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: osdmap e327: 8 total, 8 up, 8 in 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:05.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:05 smithi173 ceph-mon[40835]: pgmap v464: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/119328150' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi173-80353-62"}]': finished 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: osdmap e327: 8 total, 8 up, 8 in 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:06.080 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:06.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:06.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:06.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:06.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:06.081 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:05 smithi175 ceph-mon[32813]: pgmap v464: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:06.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: osdmap e328: 8 total, 8 up, 8 in 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: osdmap e328: 8 total, 8 up, 8 in 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi173-80353-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: osdmap e328: 8 total, 8 up, 8 in 2024-09-11T08:25:07.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:07.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:07.927 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:07] "GET /metrics HTTP/1.1" 200 228491 "" "Prometheus/2.43.0" 2024-09-11T08:25:08.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: osdmap e329: 8 total, 8 up, 8 in 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: osdmap e330: 8 total, 8 up, 8 in 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: osdmap e329: 8 total, 8 up, 8 in 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: osdmap e330: 8 total, 8 up, 8 in 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:08.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: osdmap e329: 8 total, 8 up, 8 in 2024-09-11T08:25:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:08.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: pgmap v467: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:08.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi173-80353-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:08.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:08.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: osdmap e330: 8 total, 8 up, 8 in 2024-09-11T08:25:08.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:08.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]: dispatch 2024-09-11T08:25:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]': finished 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[29664]: osdmap e331: 8 total, 8 up, 8 in 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]': finished 2024-09-11T08:25:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:08 smithi173 ceph-mon[40835]: osdmap e331: 8 total, 8 up, 8 in 2024-09-11T08:25:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:08 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:08 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-49", "mode": "readproxy"}]': finished 2024-09-11T08:25:09.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:08 smithi175 ceph-mon[32813]: osdmap e331: 8 total, 8 up, 8 in 2024-09-11T08:25:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[29664]: pgmap v470: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[29664]: osdmap e332: 8 total, 8 up, 8 in 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[40835]: pgmap v470: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[40835]: osdmap e332: 8 total, 8 up, 8 in 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:09 smithi175 ceph-mon[32813]: pgmap v470: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:25:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:09 smithi175 ceph-mon[32813]: osdmap e332: 8 total, 8 up, 8 in 2024-09-11T08:25:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:10.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[29664]: osdmap e333: 8 total, 8 up, 8 in 2024-09-11T08:25:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[29664]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[40835]: osdmap e333: 8 total, 8 up, 8 in 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:11 smithi173 ceph-mon[40835]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:11 smithi175 ceph-mon[32813]: osdmap e333: 8 total, 8 up, 8 in 2024-09-11T08:25:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/794239775' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]: dispatch 2024-09-11T08:25:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:11 smithi175 ceph-mon[32813]: pgmap v473: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: osdmap e334: 8 total, 8 up, 8 in 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: osdmap e334: 8 total, 8 up, 8 in 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:12.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi173-80353-63"}]': finished 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: osdmap e334: 8 total, 8 up, 8 in 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:13.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:13.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:13 smithi175 ceph-mon[32813]: osdmap e335: 8 total, 8 up, 8 in 2024-09-11T08:25:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:13 smithi175 ceph-mon[32813]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[29664]: osdmap e335: 8 total, 8 up, 8 in 2024-09-11T08:25:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[29664]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi173-80353-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[40835]: osdmap e335: 8 total, 8 up, 8 in 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:13 smithi173 ceph-mon[40835]: pgmap v476: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T08:25:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:14 smithi175 ceph-mon[32813]: osdmap e336: 8 total, 8 up, 8 in 2024-09-11T08:25:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:14 smithi173 ceph-mon[29664]: osdmap e336: 8 total, 8 up, 8 in 2024-09-11T08:25:15.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:14 smithi173 ceph-mon[40835]: osdmap e336: 8 total, 8 up, 8 in 2024-09-11T08:25:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:16.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:16.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:15 smithi175 ceph-mon[32813]: osdmap e337: 8 total, 8 up, 8 in 2024-09-11T08:25:16.091 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:15 smithi175 ceph-mon[32813]: pgmap v479: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:16.117 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:16.117 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[29664]: osdmap e337: 8 total, 8 up, 8 in 2024-09-11T08:25:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[29664]: pgmap v479: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi173-80353-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[40835]: osdmap e337: 8 total, 8 up, 8 in 2024-09-11T08:25:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:15 smithi173 ceph-mon[40835]: pgmap v479: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:16.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:16 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:16 smithi175 ceph-mon[32813]: osdmap e338: 8 total, 8 up, 8 in 2024-09-11T08:25:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[29664]: osdmap e338: 8 total, 8 up, 8 in 2024-09-11T08:25:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[40835]: osdmap e338: 8 total, 8 up, 8 in 2024-09-11T08:25:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:17] "GET /metrics HTTP/1.1" 200 228491 "" "Prometheus/2.43.0" 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[29664]: osdmap e339: 8 total, 8 up, 8 in 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[29664]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[40835]: osdmap e339: 8 total, 8 up, 8 in 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:17 smithi173 ceph-mon[40835]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:17 smithi175 ceph-mon[32813]: osdmap e339: 8 total, 8 up, 8 in 2024-09-11T08:25:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:17 smithi175 ceph-mon[32813]: pgmap v482: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:18 smithi175 ceph-mon[32813]: osdmap e340: 8 total, 8 up, 8 in 2024-09-11T08:25:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[29664]: osdmap e340: 8 total, 8 up, 8 in 2024-09-11T08:25:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:19.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[40835]: osdmap e340: 8 total, 8 up, 8 in 2024-09-11T08:25:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3171460359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]: dispatch 2024-09-11T08:25:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: osdmap e341: 8 total, 8 up, 8 in 2024-09-11T08:25:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:20.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: osdmap e341: 8 total, 8 up, 8 in 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi173-80353-64"}]': finished 2024-09-11T08:25:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: osdmap e341: 8 total, 8 up, 8 in 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: pgmap v485: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:20.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: osdmap e342: 8 total, 8 up, 8 in 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: osdmap e342: 8 total, 8 up, 8 in 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi173-80353-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: osdmap e342: 8 total, 8 up, 8 in 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:21.782 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullP3:head 2024-09-11T08:25:21.782 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:5d165639:::164:head 2024-09-11T08:25:21.782 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f43765fc:::165:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b4c720e9:::166:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e694b040:::167:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:afa38db2:::168:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:77ba9f53:::169:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:87495034:::170:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7c96bf0e:::171:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:dbe346cc:::172:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:e943ec24:::173:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f97a9c0c:::174:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:6f26e74d:::175:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4f95e106:::176:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:0e6f2f8f:::177:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:05db05f1:::178:head 2024-09-11T08:25:21.783 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:38a78d66:::179:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:d095610b:::180:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:a1a9d709:::181:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:1e5d39db:::182:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:f7df4fb9:::183:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:03a7f161:::184:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ba70721e:::185:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:28e5662d:::186:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:973d52de:::187:head 2024-09-11T08:25:21.784 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:4303eb1c:::188:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:b990b48e:::189:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:29b8165b:::190:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:3547f197:::191:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:7e260936:::192:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:1abec7b1:::193:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:10fdda93:::194:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:15817eea:::195:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:770bab57:::196:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:ed9e13e7:::197:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:71471a8f:::198:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: checking for 194:10fb1d02:::199:head 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8278 ms) 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T08:25:21.785 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: first is 1726043076 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,1726043084,1726043085,0 2024-09-11T08:25:21.786 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,1726043084,1726043085,0 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043076,1726043078,1726043079,1726043081,1726043082,1726043084,1726043085,0 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043079,1726043081,1726043082,1726043084,1726043085,1726043087,1726043088,0 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: first now 1726043079, trimmed 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20819 ms) 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: foo0 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14029 ms) 2024-09-11T08:25:21.787 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: osdmap e343: 8 total, 8 up, 8 in 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:21 smithi175 ceph-mon[32813]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: osdmap e343: 8 total, 8 up, 8 in 2024-09-11T08:25:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[29664]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]': finished 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: osdmap e343: 8 total, 8 up, 8 in 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-49"}]: dispatch 2024-09-11T08:25:22.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:21 smithi173 ceph-mon[40835]: pgmap v488: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:22 smithi175 ceph-mon[32813]: osdmap e344: 8 total, 8 up, 8 in 2024-09-11T08:25:23.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:23.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:22 smithi173 ceph-mon[29664]: osdmap e344: 8 total, 8 up, 8 in 2024-09-11T08:25:23.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi173-80353-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:23.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:22 smithi173 ceph-mon[40835]: osdmap e344: 8 total, 8 up, 8 in 2024-09-11T08:25:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:23 smithi175 ceph-mon[32813]: osdmap e345: 8 total, 8 up, 8 in 2024-09-11T08:25:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:23 smithi175 ceph-mon[32813]: pgmap v491: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:24.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[29664]: osdmap e345: 8 total, 8 up, 8 in 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[29664]: pgmap v491: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[40835]: osdmap e345: 8 total, 8 up, 8 in 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:24.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:23 smithi173 ceph-mon[40835]: pgmap v491: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:25.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:25.086 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:25.087 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: osdmap e346: 8 total, 8 up, 8 in 2024-09-11T08:25:25.087 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:25.087 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.087 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:25.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:25.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: osdmap e346: 8 total, 8 up, 8 in 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: osdmap e346: 8 total, 8 up, 8 in 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:25:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: osdmap e347: 8 total, 8 up, 8 in 2024-09-11T08:25:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: pgmap v494: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: osdmap e348: 8 total, 8 up, 8 in 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: osdmap e347: 8 total, 8 up, 8 in 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: pgmap v494: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: osdmap e348: 8 total, 8 up, 8 in 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: osdmap e347: 8 total, 8 up, 8 in 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]: dispatch 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: pgmap v494: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3871046656' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi173-80353-65"}]': finished 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: osdmap e348: 8 total, 8 up, 8 in 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]: dispatch 2024-09-11T08:25:26.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]': finished 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: osdmap e349: 8 total, 8 up, 8 in 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]': finished 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: osdmap e349: 8 total, 8 up, 8 in 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-51", "mode": "writeback"}]': finished 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi173-80353-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:25:27.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: osdmap e349: 8 total, 8 up, 8 in 2024-09-11T08:25:27.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:27] "GET /metrics HTTP/1.1" 200 228506 "" "Prometheus/2.43.0" 2024-09-11T08:25:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:28 smithi175 ceph-mon[32813]: pgmap v497: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:28.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[40835]: pgmap v497: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:28.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:25:28.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:28 smithi173 ceph-mon[29664]: pgmap v497: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: osdmap e350: 8 total, 8 up, 8 in 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:29.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:25:29.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: osdmap e351: 8 total, 8 up, 8 in 2024-09-11T08:25:29.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:29.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:29.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:25:29.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: osdmap e350: 8 total, 8 up, 8 in 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: osdmap e351: 8 total, 8 up, 8 in 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: osdmap e350: 8 total, 8 up, 8 in 2024-09-11T08:25:29.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi173-80353-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: osdmap e351: 8 total, 8 up, 8 in 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:29.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: pgmap v500: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: osdmap e352: 8 total, 8 up, 8 in 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:30.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:30.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: pgmap v500: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:30.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:30.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: osdmap e352: 8 total, 8 up, 8 in 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: pgmap v500: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: osdmap e352: 8 total, 8 up, 8 in 2024-09-11T08:25:30.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:30.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:25:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:25:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: osdmap e353: 8 total, 8 up, 8 in 2024-09-11T08:25:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:31 smithi175 ceph-mon[32813]: pgmap v503: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: osdmap e353: 8 total, 8 up, 8 in 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[29664]: pgmap v503: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: osdmap e353: 8 total, 8 up, 8 in 2024-09-11T08:25:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:25:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:31 smithi173 ceph-mon[40835]: pgmap v503: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:32.829 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ P2 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3009 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7015 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7018 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7024 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7055 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7039 ms) 2024-09-11T08:25:32.830 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7023 ms) 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139055 ms total) 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (294501 ms total) 2024-09-11T08:25:32.831 INFO:tasks.workunit.client.0.smithi173.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-09-11T08:25:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:25:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:32 smithi175 ceph-mon[32813]: osdmap e354: 8 total, 8 up, 8 in 2024-09-11T08:25:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:25:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[29664]: osdmap e354: 8 total, 8 up, 8 in 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-51","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[40835]: osdmap e354: 8 total, 8 up, 8 in 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3761204369' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]: dispatch 2024-09-11T08:25:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:33 smithi175 ceph-mon[32813]: osdmap e355: 8 total, 8 up, 8 in 2024-09-11T08:25:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:33 smithi175 ceph-mon[32813]: pgmap v506: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:34.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:34.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[29664]: osdmap e355: 8 total, 8 up, 8 in 2024-09-11T08:25:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[29664]: pgmap v506: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi173-80353-66"}]': finished 2024-09-11T08:25:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[40835]: osdmap e355: 8 total, 8 up, 8 in 2024-09-11T08:25:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:33 smithi173 ceph-mon[40835]: pgmap v506: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:25:35.094 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:35.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:34 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:25:35.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:34 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:35.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:34 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:25:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:35.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:25:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:34 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:35 smithi175 ceph-mon[32813]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:25:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:35 smithi173 ceph-mon[29664]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:25:36.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:35 smithi173 ceph-mon[40835]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:25:36.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:37.843 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:37] "GET /metrics HTTP/1.1" 200 228619 "" "Prometheus/2.43.0" 2024-09-11T08:25:38.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:37 smithi173 ceph-mon[29664]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 795 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:38.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:37 smithi173 ceph-mon[40835]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 795 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:38.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:37 smithi175 ceph-mon[32813]: pgmap v508: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 795 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:40 smithi175 ceph-mon[32813]: pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:25:40.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:40 smithi173 ceph-mon[29664]: pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:25:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:40 smithi173 ceph-mon[40835]: pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:25:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:42 smithi175 ceph-mon[32813]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[29664]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[40835]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:43 smithi175 ceph-mon[32813]: osdmap e356: 8 total, 8 up, 8 in 2024-09-11T08:25:43.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:43.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[29664]: osdmap e356: 8 total, 8 up, 8 in 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[40835]: osdmap e356: 8 total, 8 up, 8 in 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:43.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: osdmap e357: 8 total, 8 up, 8 in 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: osdmap e357: 8 total, 8 up, 8 in 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]': finished 2024-09-11T08:25:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: osdmap e357: 8 total, 8 up, 8 in 2024-09-11T08:25:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:44.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-51"}]: dispatch 2024-09-11T08:25:45.331 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:45.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:45 smithi175 ceph-mon[32813]: osdmap e358: 8 total, 8 up, 8 in 2024-09-11T08:25:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:45 smithi173 ceph-mon[29664]: osdmap e358: 8 total, 8 up, 8 in 2024-09-11T08:25:45.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:45 smithi173 ceph-mon[40835]: osdmap e358: 8 total, 8 up, 8 in 2024-09-11T08:25:46.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-mon[32813]: pgmap v515: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-11T08:25:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:25:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-mon[32813]: osdmap e359: 8 total, 8 up, 8 in 2024-09-11T08:25:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:46.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[40835]: pgmap v515: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-11T08:25:46.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:25:46.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[40835]: osdmap e359: 8 total, 8 up, 8 in 2024-09-11T08:25:46.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[29664]: pgmap v515: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[29664]: osdmap e359: 8 total, 8 up, 8 in 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:46.619 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:47.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:47] "GET /metrics HTTP/1.1" 200 228619 "" "Prometheus/2.43.0" 2024-09-11T08:25:47.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:47.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: osdmap e360: 8 total, 8 up, 8 in 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: osdmap e360: 8 total, 8 up, 8 in 2024-09-11T08:25:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: osdmap e360: 8 total, 8 up, 8 in 2024-09-11T08:25:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:47.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-53"}]: dispatch 2024-09-11T08:25:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:48 smithi173 ceph-mon[40835]: pgmap v518: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:25:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:48 smithi173 ceph-mon[40835]: osdmap e361: 8 total, 8 up, 8 in 2024-09-11T08:25:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:48 smithi173 ceph-mon[29664]: pgmap v518: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:25:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:48 smithi173 ceph-mon[29664]: osdmap e361: 8 total, 8 up, 8 in 2024-09-11T08:25:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:48 smithi175 ceph-mon[32813]: pgmap v518: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:25:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:48 smithi175 ceph-mon[32813]: osdmap e361: 8 total, 8 up, 8 in 2024-09-11T08:25:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[29664]: osdmap e362: 8 total, 8 up, 8 in 2024-09-11T08:25:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[29664]: pgmap v521: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[40835]: osdmap e362: 8 total, 8 up, 8 in 2024-09-11T08:25:49.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:49 smithi173 ceph-mon[40835]: pgmap v521: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:49 smithi175 ceph-mon[32813]: osdmap e362: 8 total, 8 up, 8 in 2024-09-11T08:25:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:49 smithi175 ceph-mon[32813]: pgmap v521: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:25:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: osdmap e363: 8 total, 8 up, 8 in 2024-09-11T08:25:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: osdmap e363: 8 total, 8 up, 8 in 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: osdmap e363: 8 total, 8 up, 8 in 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-55"}]: dispatch 2024-09-11T08:25:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:25:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:25:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:51 smithi173 ceph-mon[29664]: osdmap e364: 8 total, 8 up, 8 in 2024-09-11T08:25:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:51 smithi173 ceph-mon[29664]: pgmap v524: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:51.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:51 smithi173 ceph-mon[40835]: osdmap e364: 8 total, 8 up, 8 in 2024-09-11T08:25:51.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:51 smithi173 ceph-mon[40835]: pgmap v524: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:51.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:51 smithi175 ceph-mon[32813]: osdmap e364: 8 total, 8 up, 8 in 2024-09-11T08:25:51.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:51 smithi175 ceph-mon[32813]: pgmap v524: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[29664]: osdmap e365: 8 total, 8 up, 8 in 2024-09-11T08:25:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[40835]: osdmap e365: 8 total, 8 up, 8 in 2024-09-11T08:25:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:52 smithi175 ceph-mon[32813]: osdmap e365: 8 total, 8 up, 8 in 2024-09-11T08:25:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: osdmap e366: 8 total, 8 up, 8 in 2024-09-11T08:25:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[29664]: pgmap v527: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: osdmap e366: 8 total, 8 up, 8 in 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:53 smithi173 ceph-mon[40835]: pgmap v527: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: osdmap e366: 8 total, 8 up, 8 in 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-57"}]: dispatch 2024-09-11T08:25:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:53 smithi175 ceph-mon[32813]: pgmap v527: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:54 smithi173 ceph-mon[29664]: osdmap e367: 8 total, 8 up, 8 in 2024-09-11T08:25:54.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:54 smithi173 ceph-mon[40835]: osdmap e367: 8 total, 8 up, 8 in 2024-09-11T08:25:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:54 smithi175 ceph-mon[32813]: osdmap e367: 8 total, 8 up, 8 in 2024-09-11T08:25:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:25:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[29664]: osdmap e368: 8 total, 8 up, 8 in 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[29664]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[40835]: osdmap e368: 8 total, 8 up, 8 in 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:55 smithi173 ceph-mon[40835]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-mon[32813]: osdmap e368: 8 total, 8 up, 8 in 2024-09-11T08:25:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:25:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:55 smithi175 ceph-mon[32813]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:25:56.421 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:25:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: osdmap e369: 8 total, 8 up, 8 in 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: osdmap e369: 8 total, 8 up, 8 in 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: osdmap e369: 8 total, 8 up, 8 in 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-59"}]: dispatch 2024-09-11T08:25:56.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:25:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:57 smithi173 ceph-mon[29664]: osdmap e370: 8 total, 8 up, 8 in 2024-09-11T08:25:57.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:57 smithi173 ceph-mon[29664]: pgmap v533: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:57.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:25:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:25:57] "GET /metrics HTTP/1.1" 200 228564 "" "Prometheus/2.43.0" 2024-09-11T08:25:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:57 smithi173 ceph-mon[40835]: osdmap e370: 8 total, 8 up, 8 in 2024-09-11T08:25:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:57 smithi173 ceph-mon[40835]: pgmap v533: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:57 smithi175 ceph-mon[32813]: osdmap e370: 8 total, 8 up, 8 in 2024-09-11T08:25:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:57 smithi175 ceph-mon[32813]: pgmap v533: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[29664]: osdmap e371: 8 total, 8 up, 8 in 2024-09-11T08:25:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[40835]: osdmap e371: 8 total, 8 up, 8 in 2024-09-11T08:25:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:58 smithi175 ceph-mon[32813]: osdmap e371: 8 total, 8 up, 8 in 2024-09-11T08:25:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:25:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: osdmap e372: 8 total, 8 up, 8 in 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[29664]: pgmap v536: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: osdmap e372: 8 total, 8 up, 8 in 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:25:59 smithi173 ceph-mon[40835]: pgmap v536: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:25:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:25:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: osdmap e372: 8 total, 8 up, 8 in 2024-09-11T08:25:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:25:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:25:59.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:25:59 smithi175 ceph-mon[32813]: pgmap v536: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-11T08:26:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: osdmap e373: 8 total, 8 up, 8 in 2024-09-11T08:26:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: osdmap e373: 8 total, 8 up, 8 in 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: osdmap e373: 8 total, 8 up, 8 in 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-61"}]: dispatch 2024-09-11T08:26:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:01 smithi173 ceph-mon[29664]: osdmap e374: 8 total, 8 up, 8 in 2024-09-11T08:26:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:01 smithi173 ceph-mon[29664]: pgmap v539: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:01 smithi173 ceph-mon[40835]: osdmap e374: 8 total, 8 up, 8 in 2024-09-11T08:26:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:01 smithi173 ceph-mon[40835]: pgmap v539: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:01 smithi175 ceph-mon[32813]: osdmap e374: 8 total, 8 up, 8 in 2024-09-11T08:26:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:01 smithi175 ceph-mon[32813]: pgmap v539: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:02 smithi175 ceph-mon[32813]: osdmap e375: 8 total, 8 up, 8 in 2024-09-11T08:26:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[29664]: osdmap e375: 8 total, 8 up, 8 in 2024-09-11T08:26:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[40835]: osdmap e375: 8 total, 8 up, 8 in 2024-09-11T08:26:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: osdmap e376: 8 total, 8 up, 8 in 2024-09-11T08:26:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:26:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:26:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:26:03.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:26:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: osdmap e376: 8 total, 8 up, 8 in 2024-09-11T08:26:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: osdmap e376: 8 total, 8 up, 8 in 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:26:03.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:26:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:04 smithi175 ceph-mon[32813]: osdmap e377: 8 total, 8 up, 8 in 2024-09-11T08:26:04.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:04 smithi173 ceph-mon[29664]: osdmap e377: 8 total, 8 up, 8 in 2024-09-11T08:26:04.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:04.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:04 smithi173 ceph-mon[40835]: osdmap e377: 8 total, 8 up, 8 in 2024-09-11T08:26:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:05 smithi175 ceph-mon[32813]: osdmap e378: 8 total, 8 up, 8 in 2024-09-11T08:26:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:05 smithi175 ceph-mon[32813]: pgmap v545: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:05.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[29664]: osdmap e378: 8 total, 8 up, 8 in 2024-09-11T08:26:05.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:05.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[29664]: pgmap v545: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:05.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[40835]: osdmap e378: 8 total, 8 up, 8 in 2024-09-11T08:26:05.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:05.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:05 smithi173 ceph-mon[40835]: pgmap v545: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:06.500 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:06 smithi175 ceph-mon[32813]: osdmap e379: 8 total, 8 up, 8 in 2024-09-11T08:26:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:06.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:06 smithi173 ceph-mon[29664]: osdmap e379: 8 total, 8 up, 8 in 2024-09-11T08:26:06.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:06.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:06 smithi173 ceph-mon[40835]: osdmap e379: 8 total, 8 up, 8 in 2024-09-11T08:26:06.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:07 smithi175 ceph-mon[32813]: osdmap e380: 8 total, 8 up, 8 in 2024-09-11T08:26:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:07 smithi175 ceph-mon[32813]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-11T08:26:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:07 smithi173 ceph-mon[29664]: osdmap e380: 8 total, 8 up, 8 in 2024-09-11T08:26:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:07 smithi173 ceph-mon[29664]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-11T08:26:07.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:07] "GET /metrics HTTP/1.1" 200 228584 "" "Prometheus/2.43.0" 2024-09-11T08:26:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:07 smithi173 ceph-mon[40835]: osdmap e380: 8 total, 8 up, 8 in 2024-09-11T08:26:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:07 smithi173 ceph-mon[40835]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-11T08:26:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:08 smithi175 ceph-mon[32813]: osdmap e381: 8 total, 8 up, 8 in 2024-09-11T08:26:08.969 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:08 smithi173 ceph-mon[29664]: osdmap e381: 8 total, 8 up, 8 in 2024-09-11T08:26:08.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:08 smithi173 ceph-mon[40835]: osdmap e381: 8 total, 8 up, 8 in 2024-09-11T08:26:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:09 smithi175 ceph-mon[32813]: pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-11T08:26:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:09 smithi173 ceph-mon[29664]: pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-11T08:26:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:09 smithi173 ceph-mon[40835]: pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-11T08:26:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:12 smithi175 ceph-mon[32813]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T08:26:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:12 smithi173 ceph-mon[29664]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T08:26:12.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:12 smithi173 ceph-mon[40835]: pgmap v551: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T08:26:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:14 smithi175 ceph-mon[32813]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-11T08:26:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:14 smithi173 ceph-mon[29664]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-11T08:26:14.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:14 smithi173 ceph-mon[40835]: pgmap v552: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-11T08:26:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:15 smithi175 ceph-mon[32813]: osdmap e382: 8 total, 8 up, 8 in 2024-09-11T08:26:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:15 smithi175 ceph-mon[32813]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:26:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:15 smithi173 ceph-mon[29664]: osdmap e382: 8 total, 8 up, 8 in 2024-09-11T08:26:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:15 smithi173 ceph-mon[29664]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:26:15.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:15 smithi173 ceph-mon[40835]: osdmap e382: 8 total, 8 up, 8 in 2024-09-11T08:26:15.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:15 smithi173 ceph-mon[40835]: pgmap v554: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:26:16.585 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:16.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:16.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:16.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:17 smithi175 ceph-mon[32813]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 210 B/s wr, 1 op/s 2024-09-11T08:26:17.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:17 smithi173 ceph-mon[29664]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 210 B/s wr, 1 op/s 2024-09-11T08:26:17.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:17] "GET /metrics HTTP/1.1" 200 228584 "" "Prometheus/2.43.0" 2024-09-11T08:26:17.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:17 smithi173 ceph-mon[40835]: pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 210 B/s wr, 1 op/s 2024-09-11T08:26:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:18 smithi175 ceph-mon[32813]: osdmap e383: 8 total, 8 up, 8 in 2024-09-11T08:26:18.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:18 smithi173 ceph-mon[29664]: osdmap e383: 8 total, 8 up, 8 in 2024-09-11T08:26:18.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:18 smithi173 ceph-mon[40835]: osdmap e383: 8 total, 8 up, 8 in 2024-09-11T08:26:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:19 smithi173 ceph-mon[29664]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:19.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:19 smithi173 ceph-mon[40835]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:19 smithi175 ceph-mon[32813]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:20.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:21 smithi173 ceph-mon[29664]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:21.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:21 smithi173 ceph-mon[40835]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:21.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:21 smithi175 ceph-mon[32813]: pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:24 smithi175 ceph-mon[32813]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:24 smithi173 ceph-mon[29664]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:24 smithi173 ceph-mon[40835]: pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:25 smithi175 ceph-mon[32813]: osdmap e384: 8 total, 8 up, 8 in 2024-09-11T08:26:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:25 smithi175 ceph-mon[32813]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:25 smithi173 ceph-mon[29664]: osdmap e384: 8 total, 8 up, 8 in 2024-09-11T08:26:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:25 smithi173 ceph-mon[29664]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:25 smithi173 ceph-mon[40835]: osdmap e384: 8 total, 8 up, 8 in 2024-09-11T08:26:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:25 smithi173 ceph-mon[40835]: pgmap v561: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:26.590 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:26.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:27 smithi173 ceph-mon[29664]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:27 smithi173 ceph-mon[40835]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:27.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:27] "GET /metrics HTTP/1.1" 200 228593 "" "Prometheus/2.43.0" 2024-09-11T08:26:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:27 smithi175 ceph-mon[32813]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:26:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:29 smithi173 ceph-mon[29664]: osdmap e385: 8 total, 8 up, 8 in 2024-09-11T08:26:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:29 smithi173 ceph-mon[29664]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:29.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:29 smithi173 ceph-mon[40835]: osdmap e385: 8 total, 8 up, 8 in 2024-09-11T08:26:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:29 smithi173 ceph-mon[40835]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:29 smithi175 ceph-mon[32813]: osdmap e385: 8 total, 8 up, 8 in 2024-09-11T08:26:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:29 smithi175 ceph-mon[32813]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:26:32.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:32 smithi175 ceph-mon[32813]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:26:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:32 smithi173 ceph-mon[29664]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:26:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:32 smithi173 ceph-mon[40835]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-11T08:26:34.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:34 smithi175 ceph-mon[32813]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:34 smithi173 ceph-mon[29664]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:34.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:34 smithi173 ceph-mon[40835]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:35 smithi175 ceph-mon[32813]: osdmap e386: 8 total, 8 up, 8 in 2024-09-11T08:26:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:35 smithi175 ceph-mon[32813]: pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:26:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[29664]: osdmap e386: 8 total, 8 up, 8 in 2024-09-11T08:26:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[29664]: pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:26:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[40835]: osdmap e386: 8 total, 8 up, 8 in 2024-09-11T08:26:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:35 smithi173 ceph-mon[40835]: pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:26:36.586 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:37 smithi173 ceph-mon[29664]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:37] "GET /metrics HTTP/1.1" 200 228621 "" "Prometheus/2.43.0" 2024-09-11T08:26:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:37 smithi173 ceph-mon[40835]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:37 smithi175 ceph-mon[32813]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:26:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-63"}]: dispatch 2024-09-11T08:26:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:39 smithi173 ceph-mon[29664]: osdmap e387: 8 total, 8 up, 8 in 2024-09-11T08:26:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:39 smithi173 ceph-mon[29664]: pgmap v571: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:39 smithi173 ceph-mon[40835]: osdmap e387: 8 total, 8 up, 8 in 2024-09-11T08:26:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:39 smithi173 ceph-mon[40835]: pgmap v571: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:39 smithi175 ceph-mon[32813]: osdmap e387: 8 total, 8 up, 8 in 2024-09-11T08:26:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:39 smithi175 ceph-mon[32813]: pgmap v571: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[29664]: osdmap e388: 8 total, 8 up, 8 in 2024-09-11T08:26:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[40835]: osdmap e388: 8 total, 8 up, 8 in 2024-09-11T08:26:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:40 smithi175 ceph-mon[32813]: osdmap e388: 8 total, 8 up, 8 in 2024-09-11T08:26:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:41.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: osdmap e389: 8 total, 8 up, 8 in 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:41 smithi175 ceph-mon[32813]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: osdmap e389: 8 total, 8 up, 8 in 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[29664]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: osdmap e389: 8 total, 8 up, 8 in 2024-09-11T08:26:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:26:42.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:41 smithi173 ceph-mon[40835]: pgmap v574: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:42 smithi175 ceph-mon[32813]: osdmap e390: 8 total, 8 up, 8 in 2024-09-11T08:26:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:42 smithi173 ceph-mon[29664]: osdmap e390: 8 total, 8 up, 8 in 2024-09-11T08:26:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:26:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:42 smithi173 ceph-mon[40835]: osdmap e390: 8 total, 8 up, 8 in 2024-09-11T08:26:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:43 smithi175 ceph-mon[32813]: osdmap e391: 8 total, 8 up, 8 in 2024-09-11T08:26:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:43 smithi175 ceph-mon[32813]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:26:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:43 smithi173 ceph-mon[29664]: osdmap e391: 8 total, 8 up, 8 in 2024-09-11T08:26:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:43 smithi173 ceph-mon[29664]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:26:44.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:43 smithi173 ceph-mon[40835]: osdmap e391: 8 total, 8 up, 8 in 2024-09-11T08:26:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:43 smithi173 ceph-mon[40835]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:26:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:44 smithi175 ceph-mon[32813]: osdmap e392: 8 total, 8 up, 8 in 2024-09-11T08:26:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:44 smithi173 ceph-mon[29664]: osdmap e392: 8 total, 8 up, 8 in 2024-09-11T08:26:45.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:44 smithi173 ceph-mon[40835]: osdmap e392: 8 total, 8 up, 8 in 2024-09-11T08:26:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:45 smithi175 ceph-mon[32813]: osdmap e393: 8 total, 8 up, 8 in 2024-09-11T08:26:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:45 smithi175 ceph-mon[32813]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:46.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:45 smithi173 ceph-mon[29664]: osdmap e393: 8 total, 8 up, 8 in 2024-09-11T08:26:46.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:45 smithi173 ceph-mon[29664]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:46.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:45 smithi173 ceph-mon[40835]: osdmap e393: 8 total, 8 up, 8 in 2024-09-11T08:26:46.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:45 smithi173 ceph-mon[40835]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:46.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:47.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:47 smithi173 ceph-mon[29664]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T08:26:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:47] "GET /metrics HTTP/1.1" 200 228621 "" "Prometheus/2.43.0" 2024-09-11T08:26:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:47 smithi173 ceph-mon[40835]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T08:26:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:47 smithi175 ceph-mon[32813]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T08:26:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:50 smithi175 ceph-mon[32813]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T08:26:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:50 smithi175 ceph-mon[32813]: osdmap e394: 8 total, 8 up, 8 in 2024-09-11T08:26:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[29664]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T08:26:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[29664]: osdmap e394: 8 total, 8 up, 8 in 2024-09-11T08:26:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[40835]: pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-11T08:26:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[40835]: osdmap e394: 8 total, 8 up, 8 in 2024-09-11T08:26:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:26:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:52 smithi175 ceph-mon[32813]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T08:26:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:52 smithi173 ceph-mon[29664]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T08:26:52.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:52 smithi173 ceph-mon[40835]: pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T08:26:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:54 smithi175 ceph-mon[32813]: pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T08:26:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:54 smithi173 ceph-mon[29664]: pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T08:26:54.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:54 smithi173 ceph-mon[40835]: pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T08:26:55.332 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:26:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:26:55.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:55.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-65"}]: dispatch 2024-09-11T08:26:56.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:26:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:26:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:56 smithi175 ceph-mon[32813]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-11T08:26:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:56 smithi175 ceph-mon[32813]: osdmap e395: 8 total, 8 up, 8 in 2024-09-11T08:26:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:56 smithi173 ceph-mon[29664]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-11T08:26:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:56 smithi173 ceph-mon[29664]: osdmap e395: 8 total, 8 up, 8 in 2024-09-11T08:26:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:56 smithi173 ceph-mon[40835]: pgmap v586: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-11T08:26:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:56 smithi173 ceph-mon[40835]: osdmap e395: 8 total, 8 up, 8 in 2024-09-11T08:26:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[29664]: osdmap e396: 8 total, 8 up, 8 in 2024-09-11T08:26:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:57.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:26:57] "GET /metrics HTTP/1.1" 200 228624 "" "Prometheus/2.43.0" 2024-09-11T08:26:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[40835]: osdmap e396: 8 total, 8 up, 8 in 2024-09-11T08:26:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:57.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:26:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:57 smithi175 ceph-mon[32813]: osdmap e396: 8 total, 8 up, 8 in 2024-09-11T08:26:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:26:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[29664]: pgmap v589: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:26:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[29664]: osdmap e397: 8 total, 8 up, 8 in 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[40835]: pgmap v589: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[40835]: osdmap e397: 8 total, 8 up, 8 in 2024-09-11T08:26:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:58 smithi175 ceph-mon[32813]: pgmap v589: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:26:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:58 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:26:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:26:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:58 smithi175 ceph-mon[32813]: osdmap e397: 8 total, 8 up, 8 in 2024-09-11T08:26:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:26:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[29664]: osdmap e398: 8 total, 8 up, 8 in 2024-09-11T08:26:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[40835]: osdmap e398: 8 total, 8 up, 8 in 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:26:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:26:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:26:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:59 smithi175 ceph-mon[32813]: osdmap e398: 8 total, 8 up, 8 in 2024-09-11T08:26:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:26:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:26:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:26:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-67"}]: dispatch 2024-09-11T08:27:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:00 smithi173 ceph-mon[29664]: pgmap v592: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:00 smithi173 ceph-mon[29664]: osdmap e399: 8 total, 8 up, 8 in 2024-09-11T08:27:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:00 smithi173 ceph-mon[40835]: pgmap v592: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:00 smithi173 ceph-mon[40835]: osdmap e399: 8 total, 8 up, 8 in 2024-09-11T08:27:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:00 smithi175 ceph-mon[32813]: pgmap v592: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:00 smithi175 ceph-mon[32813]: osdmap e399: 8 total, 8 up, 8 in 2024-09-11T08:27:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: osdmap e400: 8 total, 8 up, 8 in 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: pgmap v595: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: osdmap e401: 8 total, 8 up, 8 in 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: osdmap e400: 8 total, 8 up, 8 in 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: pgmap v595: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: osdmap e401: 8 total, 8 up, 8 in 2024-09-11T08:27:01.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: osdmap e400: 8 total, 8 up, 8 in 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: pgmap v595: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: osdmap e401: 8 total, 8 up, 8 in 2024-09-11T08:27:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[29664]: osdmap e402: 8 total, 8 up, 8 in 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:02 smithi173 ceph-mon[40835]: osdmap e402: 8 total, 8 up, 8 in 2024-09-11T08:27:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-69"}]: dispatch 2024-09-11T08:27:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:02 smithi175 ceph-mon[32813]: osdmap e402: 8 total, 8 up, 8 in 2024-09-11T08:27:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:03 smithi173 ceph-mon[29664]: pgmap v598: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:03 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:27:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:03 smithi173 ceph-mon[40835]: pgmap v598: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:03 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:27:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:03 smithi175 ceph-mon[32813]: pgmap v598: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:03 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:27:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: osdmap e403: 8 total, 8 up, 8 in 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: osdmap e403: 8 total, 8 up, 8 in 2024-09-11T08:27:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:27:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:27:04.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: osdmap e403: 8 total, 8 up, 8 in 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:27:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:27:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: osdmap e404: 8 total, 8 up, 8 in 2024-09-11T08:27:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[29664]: pgmap v601: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: osdmap e404: 8 total, 8 up, 8 in 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:05 smithi173 ceph-mon[40835]: pgmap v601: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: osdmap e404: 8 total, 8 up, 8 in 2024-09-11T08:27:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:27:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:05 smithi175 ceph-mon[32813]: pgmap v601: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:06.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:27:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:06 smithi175 ceph-mon[32813]: osdmap e405: 8 total, 8 up, 8 in 2024-09-11T08:27:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:27:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[29664]: osdmap e405: 8 total, 8 up, 8 in 2024-09-11T08:27:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:27:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[40835]: osdmap e405: 8 total, 8 up, 8 in 2024-09-11T08:27:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:07.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:07] "GET /metrics HTTP/1.1" 200 228598 "" "Prometheus/2.43.0" 2024-09-11T08:27:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:07 smithi173 ceph-mon[29664]: osdmap e406: 8 total, 8 up, 8 in 2024-09-11T08:27:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:07 smithi173 ceph-mon[29664]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-11T08:27:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:07 smithi173 ceph-mon[40835]: osdmap e406: 8 total, 8 up, 8 in 2024-09-11T08:27:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:07 smithi173 ceph-mon[40835]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-11T08:27:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:07 smithi175 ceph-mon[32813]: osdmap e406: 8 total, 8 up, 8 in 2024-09-11T08:27:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:07 smithi175 ceph-mon[32813]: pgmap v604: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-09-11T08:27:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:10 smithi175 ceph-mon[32813]: pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:10 smithi173 ceph-mon[29664]: pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:10.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:10 smithi173 ceph-mon[40835]: pgmap v605: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:12 smithi175 ceph-mon[32813]: pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-11T08:27:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:12 smithi173 ceph-mon[29664]: pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-11T08:27:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:12 smithi173 ceph-mon[40835]: pgmap v606: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-11T08:27:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:14 smithi175 ceph-mon[32813]: pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:14 smithi173 ceph-mon[29664]: pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:14 smithi173 ceph-mon[40835]: pgmap v607: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-11T08:27:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:16 smithi175 ceph-mon[32813]: pgmap v608: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-11T08:27:16.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:16 smithi173 ceph-mon[29664]: pgmap v608: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-11T08:27:16.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:16 smithi173 ceph-mon[40835]: pgmap v608: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-11T08:27:17.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:17.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:17] "GET /metrics HTTP/1.1" 200 228598 "" "Prometheus/2.43.0" 2024-09-11T08:27:17.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:18.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:18 smithi175 ceph-mon[32813]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 377 B/s wr, 1 op/s 2024-09-11T08:27:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:18 smithi173 ceph-mon[29664]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 377 B/s wr, 1 op/s 2024-09-11T08:27:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:18 smithi173 ceph-mon[40835]: pgmap v609: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 377 B/s wr, 1 op/s 2024-09-11T08:27:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:20 smithi173 ceph-mon[29664]: pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-11T08:27:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:20 smithi173 ceph-mon[40835]: pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-11T08:27:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:20 smithi175 ceph-mon[32813]: pgmap v610: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 341 B/s wr, 1 op/s 2024-09-11T08:27:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:22.646 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:22 smithi175 ceph-mon[32813]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T08:27:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:22 smithi173 ceph-mon[29664]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T08:27:22.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:22 smithi173 ceph-mon[40835]: pgmap v611: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T08:27:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:24 smithi173 ceph-mon[29664]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:24 smithi173 ceph-mon[40835]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:24 smithi175 ceph-mon[32813]: pgmap v612: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:26.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:26 smithi175 ceph-mon[32813]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:26 smithi173 ceph-mon[29664]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:26.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:26 smithi173 ceph-mon[40835]: pgmap v613: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:27.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:27] "GET /metrics HTTP/1.1" 200 228586 "" "Prometheus/2.43.0" 2024-09-11T08:27:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-71"}]: dispatch 2024-09-11T08:27:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:28 smithi173 ceph-mon[29664]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:28 smithi173 ceph-mon[29664]: osdmap e407: 8 total, 8 up, 8 in 2024-09-11T08:27:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:28 smithi173 ceph-mon[40835]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:28 smithi173 ceph-mon[40835]: osdmap e407: 8 total, 8 up, 8 in 2024-09-11T08:27:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:28 smithi175 ceph-mon[32813]: pgmap v614: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:27:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:28 smithi175 ceph-mon[32813]: osdmap e407: 8 total, 8 up, 8 in 2024-09-11T08:27:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[29664]: osdmap e408: 8 total, 8 up, 8 in 2024-09-11T08:27:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[29664]: pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[40835]: osdmap e408: 8 total, 8 up, 8 in 2024-09-11T08:27:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:29 smithi173 ceph-mon[40835]: pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:29 smithi175 ceph-mon[32813]: osdmap e408: 8 total, 8 up, 8 in 2024-09-11T08:27:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:29 smithi175 ceph-mon[32813]: pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[29664]: osdmap e409: 8 total, 8 up, 8 in 2024-09-11T08:27:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[40835]: osdmap e409: 8 total, 8 up, 8 in 2024-09-11T08:27:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:30 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:30 smithi175 ceph-mon[32813]: osdmap e409: 8 total, 8 up, 8 in 2024-09-11T08:27:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:31 smithi173 ceph-mon[29664]: osdmap e410: 8 total, 8 up, 8 in 2024-09-11T08:27:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:31 smithi173 ceph-mon[29664]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:31 smithi173 ceph-mon[40835]: osdmap e410: 8 total, 8 up, 8 in 2024-09-11T08:27:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:31 smithi173 ceph-mon[40835]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:31 smithi175 ceph-mon[32813]: osdmap e410: 8 total, 8 up, 8 in 2024-09-11T08:27:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:31 smithi175 ceph-mon[32813]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:32 smithi173 ceph-mon[29664]: osdmap e411: 8 total, 8 up, 8 in 2024-09-11T08:27:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:32 smithi173 ceph-mon[40835]: osdmap e411: 8 total, 8 up, 8 in 2024-09-11T08:27:32.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:32 smithi175 ceph-mon[32813]: osdmap e411: 8 total, 8 up, 8 in 2024-09-11T08:27:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:33 smithi173 ceph-mon[29664]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:27:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:33 smithi173 ceph-mon[40835]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:27:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:33 smithi175 ceph-mon[32813]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:27:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:34 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:34.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:34 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:35.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:34 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:35 smithi173 ceph-mon[29664]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:27:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:35 smithi173 ceph-mon[40835]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:27:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:36.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:35 smithi175 ceph-mon[32813]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 1 op/s 2024-09-11T08:27:36.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:37 smithi173 ceph-mon[29664]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 905 B/s wr, 4 op/s 2024-09-11T08:27:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:37] "GET /metrics HTTP/1.1" 200 228587 "" "Prometheus/2.43.0" 2024-09-11T08:27:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:37 smithi173 ceph-mon[40835]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 905 B/s wr, 4 op/s 2024-09-11T08:27:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:37 smithi175 ceph-mon[32813]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 905 B/s wr, 4 op/s 2024-09-11T08:27:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:40 smithi175 ceph-mon[32813]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 804 B/s wr, 3 op/s 2024-09-11T08:27:40.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:40 smithi173 ceph-mon[29664]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 804 B/s wr, 3 op/s 2024-09-11T08:27:40.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:40 smithi173 ceph-mon[40835]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 804 B/s wr, 3 op/s 2024-09-11T08:27:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:42 smithi175 ceph-mon[32813]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T08:27:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[29664]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T08:27:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[40835]: pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T08:27:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:42.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-73"}]: dispatch 2024-09-11T08:27:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:43 smithi173 ceph-mon[29664]: osdmap e412: 8 total, 8 up, 8 in 2024-09-11T08:27:43.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:43 smithi173 ceph-mon[40835]: osdmap e412: 8 total, 8 up, 8 in 2024-09-11T08:27:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:43 smithi175 ceph-mon[32813]: osdmap e412: 8 total, 8 up, 8 in 2024-09-11T08:27:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[29664]: pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:27:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[29664]: osdmap e413: 8 total, 8 up, 8 in 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[40835]: pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[40835]: osdmap e413: 8 total, 8 up, 8 in 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:44 smithi175 ceph-mon[32813]: pgmap v628: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:27:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:44 smithi175 ceph-mon[32813]: osdmap e413: 8 total, 8 up, 8 in 2024-09-11T08:27:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[29664]: osdmap e414: 8 total, 8 up, 8 in 2024-09-11T08:27:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[40835]: osdmap e414: 8 total, 8 up, 8 in 2024-09-11T08:27:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:45 smithi175 ceph-mon[32813]: osdmap e414: 8 total, 8 up, 8 in 2024-09-11T08:27:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:46.594 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:27:46.398+0000 7f5bb69bd640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3a5c04f1:test-rados-api-smithi173-80673-76::foo:28, removing 2024-09-11T08:27:46.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:27:46.399+0000 7f15c9989640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3a5c04f1:test-rados-api-smithi173-80673-76::foo:28, removing 2024-09-11T08:27:46.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-mon[32813]: pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:46.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-mon[32813]: osdmap e415: 8 total, 8 up, 8 in 2024-09-11T08:27:46.595 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:27:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:27:46.399+0000 7fbab05fe640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3a5c04f1:test-rados-api-smithi173-80673-76::foo:28, removing 2024-09-11T08:27:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:46 smithi173 ceph-mon[29664]: pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:46 smithi173 ceph-mon[29664]: osdmap e415: 8 total, 8 up, 8 in 2024-09-11T08:27:46.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:46 smithi173 ceph-mon[40835]: pgmap v631: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:46.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:46 smithi173 ceph-mon[40835]: osdmap e415: 8 total, 8 up, 8 in 2024-09-11T08:27:47.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:47] "GET /metrics HTTP/1.1" 200 228587 "" "Prometheus/2.43.0" 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: osdmap e416: 8 total, 8 up, 8 in 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[40835]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: osdmap e416: 8 total, 8 up, 8 in 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:47 smithi173 ceph-mon[29664]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: osdmap e416: 8 total, 8 up, 8 in 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-75"}]: dispatch 2024-09-11T08:27:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:47 smithi175 ceph-mon[32813]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:27:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:48 smithi173 ceph-mon[40835]: osdmap e417: 8 total, 8 up, 8 in 2024-09-11T08:27:48.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:48 smithi173 ceph-mon[29664]: osdmap e417: 8 total, 8 up, 8 in 2024-09-11T08:27:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:48 smithi175 ceph-mon[32813]: osdmap e417: 8 total, 8 up, 8 in 2024-09-11T08:27:49.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[40835]: osdmap e418: 8 total, 8 up, 8 in 2024-09-11T08:27:49.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[40835]: pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[29664]: osdmap e418: 8 total, 8 up, 8 in 2024-09-11T08:27:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:49 smithi173 ceph-mon[29664]: pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:49 smithi175 ceph-mon[32813]: osdmap e418: 8 total, 8 up, 8 in 2024-09-11T08:27:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:49 smithi175 ceph-mon[32813]: pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:27:50.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:50.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:50.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[40835]: osdmap e419: 8 total, 8 up, 8 in 2024-09-11T08:27:50.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:50.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[29664]: osdmap e419: 8 total, 8 up, 8 in 2024-09-11T08:27:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:50.844 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:27:50.424+0000 7f5bb69bd640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3f8fd5ad:test-rados-api-smithi173-80673-78::foo:29, removing 2024-09-11T08:27:50.844 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:27:50.424+0000 7f15c9989640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3f8fd5ad:test-rados-api-smithi173-80673-78::foo:29, removing 2024-09-11T08:27:50.845 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:27:50.424+0000 7fbab05fe640 -1 snap_mapper.add_oid found existing snaps mapped on 61:3f8fd5ad:test-rados-api-smithi173-80673-78::foo:29, removing 2024-09-11T08:27:50.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:50.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:50.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-mon[32813]: osdmap e419: 8 total, 8 up, 8 in 2024-09-11T08:27:50.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:50.846 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:27:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: osdmap e420: 8 total, 8 up, 8 in 2024-09-11T08:27:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[29664]: pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: osdmap e420: 8 total, 8 up, 8 in 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:51 smithi173 ceph-mon[40835]: pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: osdmap e420: 8 total, 8 up, 8 in 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-77"}]: dispatch 2024-09-11T08:27:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:51 smithi175 ceph-mon[32813]: pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-11T08:27:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:52 smithi173 ceph-mon[29664]: osdmap e421: 8 total, 8 up, 8 in 2024-09-11T08:27:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:52 smithi173 ceph-mon[40835]: osdmap e421: 8 total, 8 up, 8 in 2024-09-11T08:27:52.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:52 smithi175 ceph-mon[32813]: osdmap e421: 8 total, 8 up, 8 in 2024-09-11T08:27:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[29664]: osdmap e422: 8 total, 8 up, 8 in 2024-09-11T08:27:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[29664]: pgmap v643: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-11T08:27:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[40835]: osdmap e422: 8 total, 8 up, 8 in 2024-09-11T08:27:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:53 smithi173 ceph-mon[40835]: pgmap v643: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-11T08:27:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:53 smithi175 ceph-mon[32813]: osdmap e422: 8 total, 8 up, 8 in 2024-09-11T08:27:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:27:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:53 smithi175 ceph-mon[32813]: pgmap v643: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2024-09-11T08:27:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[40835]: osdmap e423: 8 total, 8 up, 8 in 2024-09-11T08:27:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[29664]: osdmap e423: 8 total, 8 up, 8 in 2024-09-11T08:27:54.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:27:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:54 smithi175 ceph-mon[32813]: osdmap e423: 8 total, 8 up, 8 in 2024-09-11T08:27:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:27:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:27:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:27:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:55 smithi173 ceph-mon[29664]: osdmap e424: 8 total, 8 up, 8 in 2024-09-11T08:27:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:55 smithi173 ceph-mon[29664]: pgmap v646: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:55 smithi173 ceph-mon[40835]: osdmap e424: 8 total, 8 up, 8 in 2024-09-11T08:27:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:55 smithi173 ceph-mon[40835]: pgmap v646: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:55 smithi175 ceph-mon[32813]: osdmap e424: 8 total, 8 up, 8 in 2024-09-11T08:27:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:55 smithi175 ceph-mon[32813]: pgmap v646: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:27:56.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:27:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:56.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: osdmap e425: 8 total, 8 up, 8 in 2024-09-11T08:27:56.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: 223.e deep-scrub starts 2024-09-11T08:27:56.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: 223.e deep-scrub ok 2024-09-11T08:27:56.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: osdmap e425: 8 total, 8 up, 8 in 2024-09-11T08:27:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: 223.e deep-scrub starts 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: 223.e deep-scrub ok 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: osdmap e425: 8 total, 8 up, 8 in 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "223.e"}]: dispatch 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: 223.e deep-scrub starts 2024-09-11T08:27:56.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: 223.e deep-scrub ok 2024-09-11T08:27:56.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:27:57.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:27:57 smithi173 ceph-mon[29664]: pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-11T08:27:57.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:27:57 smithi173 ceph-mon[40835]: pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-11T08:27:57.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:27:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:27:57] "GET /metrics HTTP/1.1" 200 228614 "" "Prometheus/2.43.0" 2024-09-11T08:27:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:27:57 smithi175 ceph-mon[32813]: pgmap v648: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-09-11T08:28:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:00 smithi173 ceph-mon[29664]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:28:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:00 smithi173 ceph-mon[40835]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:28:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:00 smithi175 ceph-mon[32813]: pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:28:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:02 smithi173 ceph-mon[29664]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 650 B/s wr, 2 op/s 2024-09-11T08:28:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:02 smithi173 ceph-mon[40835]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 650 B/s wr, 2 op/s 2024-09-11T08:28:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:02 smithi175 ceph-mon[32813]: pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 650 B/s wr, 2 op/s 2024-09-11T08:28:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[29664]: pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 577 B/s wr, 2 op/s 2024-09-11T08:28:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:28:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:28:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[40835]: pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 577 B/s wr, 2 op/s 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:28:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:28:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:04 smithi175 ceph-mon[32813]: pgmap v651: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 577 B/s wr, 2 op/s 2024-09-11T08:28:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:28:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:28:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:28:04.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:28:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:05.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:06.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:06 smithi175 ceph-mon[32813]: pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:28:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:06 smithi173 ceph-mon[29664]: pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:28:06.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:06 smithi173 ceph-mon[40835]: pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:28:07.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:07.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:07] "GET /metrics HTTP/1.1" 200 228611 "" "Prometheus/2.43.0" 2024-09-11T08:28:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:08 smithi173 ceph-mon[29664]: pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 432 B/s wr, 10 op/s 2024-09-11T08:28:08.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:08 smithi173 ceph-mon[40835]: pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 432 B/s wr, 10 op/s 2024-09-11T08:28:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:08 smithi175 ceph-mon[32813]: pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.3 KiB/s rd, 432 B/s wr, 10 op/s 2024-09-11T08:28:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:10 smithi173 ceph-mon[29664]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-11T08:28:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:10 smithi173 ceph-mon[40835]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-11T08:28:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:10 smithi175 ceph-mon[32813]: pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-11T08:28:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:12 smithi173 ceph-mon[29664]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:12 smithi173 ceph-mon[40835]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:12 smithi175 ceph-mon[32813]: pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:13 smithi173 ceph-mon[29664]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:13 smithi173 ceph-mon[40835]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:13 smithi175 ceph-mon[32813]: pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:15.844 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:28:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:28:15.478+0000 7f15ce192640 -1 snap_mapper.add_oid found existing snaps mapped on 223:7173e187:test-rados-api-smithi173-80673-80::foo:2, removing 2024-09-11T08:28:15.844 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:28:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:28:15.478+0000 7f212d600640 -1 snap_mapper.add_oid found existing snaps mapped on 223:7173e187:test-rados-api-smithi173-80673-80::foo:2, removing 2024-09-11T08:28:15.966 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:28:15 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:28:15.478+0000 7fbdc76df640 -1 snap_mapper.add_oid found existing snaps mapped on 223:7173e187:test-rados-api-smithi173-80673-80::foo:2, removing 2024-09-11T08:28:16.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-mon[32813]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[29664]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[40835]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-11T08:28:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-79"}]: dispatch 2024-09-11T08:28:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:17 smithi173 ceph-mon[29664]: osdmap e426: 8 total, 8 up, 8 in 2024-09-11T08:28:17.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:17] "GET /metrics HTTP/1.1" 200 228611 "" "Prometheus/2.43.0" 2024-09-11T08:28:17.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:17.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:17 smithi173 ceph-mon[40835]: osdmap e426: 8 total, 8 up, 8 in 2024-09-11T08:28:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:17 smithi175 ceph-mon[32813]: osdmap e426: 8 total, 8 up, 8 in 2024-09-11T08:28:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[29664]: pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-11T08:28:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[29664]: osdmap e427: 8 total, 8 up, 8 in 2024-09-11T08:28:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[40835]: pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-11T08:28:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[40835]: osdmap e427: 8 total, 8 up, 8 in 2024-09-11T08:28:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:18 smithi175 ceph-mon[32813]: pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-11T08:28:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:18 smithi175 ceph-mon[32813]: osdmap e427: 8 total, 8 up, 8 in 2024-09-11T08:28:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: osdmap e428: 8 total, 8 up, 8 in 2024-09-11T08:28:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[29664]: pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: osdmap e428: 8 total, 8 up, 8 in 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:19 smithi173 ceph-mon[40835]: pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: osdmap e428: 8 total, 8 up, 8 in 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:19 smithi175 ceph-mon[32813]: pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:28:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[29664]: osdmap e429: 8 total, 8 up, 8 in 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[40835]: osdmap e429: 8 total, 8 up, 8 in 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:20 smithi175 ceph-mon[32813]: osdmap e429: 8 total, 8 up, 8 in 2024-09-11T08:28:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[29664]: osdmap e430: 8 total, 8 up, 8 in 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[29664]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[40835]: osdmap e430: 8 total, 8 up, 8 in 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:21 smithi173 ceph-mon[40835]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:21 smithi175 ceph-mon[32813]: osdmap e430: 8 total, 8 up, 8 in 2024-09-11T08:28:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:21 smithi175 ceph-mon[32813]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[29664]: osdmap e431: 8 total, 8 up, 8 in 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[40835]: osdmap e431: 8 total, 8 up, 8 in 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:22.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:22.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:22 smithi175 ceph-mon[32813]: osdmap e431: 8 total, 8 up, 8 in 2024-09-11T08:28:22.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:22.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[29664]: osdmap e432: 8 total, 8 up, 8 in 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[29664]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[40835]: osdmap e432: 8 total, 8 up, 8 in 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:23 smithi173 ceph-mon[40835]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:23 smithi175 ceph-mon[32813]: osdmap e432: 8 total, 8 up, 8 in 2024-09-11T08:28:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-09-11T08:28:23.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:23 smithi175 ceph-mon[32813]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-11T08:28:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[29664]: osdmap e433: 8 total, 8 up, 8 in 2024-09-11T08:28:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-11T08:28:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[40835]: osdmap e433: 8 total, 8 up, 8 in 2024-09-11T08:28:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:24 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-09-11T08:28:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:24 smithi175 ceph-mon[32813]: osdmap e433: 8 total, 8 up, 8 in 2024-09-11T08:28:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:24 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-09-11T08:28:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-11T08:28:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[29664]: osdmap e434: 8 total, 8 up, 8 in 2024-09-11T08:28:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[29664]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-11T08:28:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[40835]: osdmap e434: 8 total, 8 up, 8 in 2024-09-11T08:28:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:25 smithi173 ceph-mon[40835]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-09-11T08:28:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-mon[32813]: osdmap e434: 8 total, 8 up, 8 in 2024-09-11T08:28:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:25 smithi175 ceph-mon[32813]: pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:26.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: osdmap e435: 8 total, 8 up, 8 in 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.595 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: osdmap e435: 8 total, 8 up, 8 in 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: osdmap e435: 8 total, 8 up, 8 in 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-81"}]: dispatch 2024-09-11T08:28:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:27 smithi173 ceph-mon[29664]: osdmap e436: 8 total, 8 up, 8 in 2024-09-11T08:28:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:27 smithi173 ceph-mon[29664]: pgmap v674: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:27.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:27] "GET /metrics HTTP/1.1" 200 228558 "" "Prometheus/2.43.0" 2024-09-11T08:28:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:27 smithi173 ceph-mon[40835]: osdmap e436: 8 total, 8 up, 8 in 2024-09-11T08:28:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:27 smithi173 ceph-mon[40835]: pgmap v674: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:27 smithi175 ceph-mon[32813]: osdmap e436: 8 total, 8 up, 8 in 2024-09-11T08:28:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:27 smithi175 ceph-mon[32813]: pgmap v674: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[29664]: osdmap e437: 8 total, 8 up, 8 in 2024-09-11T08:28:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[40835]: osdmap e437: 8 total, 8 up, 8 in 2024-09-11T08:28:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:28 smithi175 ceph-mon[32813]: osdmap e437: 8 total, 8 up, 8 in 2024-09-11T08:28:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: osdmap e438: 8 total, 8 up, 8 in 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: osdmap e439: 8 total, 8 up, 8 in 2024-09-11T08:28:29.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: osdmap e438: 8 total, 8 up, 8 in 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: osdmap e439: 8 total, 8 up, 8 in 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:29.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: osdmap e438: 8 total, 8 up, 8 in 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-09-11T08:28:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: osdmap e439: 8 total, 8 up, 8 in 2024-09-11T08:28:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:29.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[29664]: osdmap e440: 8 total, 8 up, 8 in 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[29664]: pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[40835]: osdmap e440: 8 total, 8 up, 8 in 2024-09-11T08:28:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:31 smithi173 ceph-mon[40835]: pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:31 smithi175 ceph-mon[32813]: osdmap e440: 8 total, 8 up, 8 in 2024-09-11T08:28:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:31 smithi175 ceph-mon[32813]: pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[29664]: osdmap e441: 8 total, 8 up, 8 in 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[40835]: osdmap e441: 8 total, 8 up, 8 in 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:32 smithi175 ceph-mon[32813]: osdmap e441: 8 total, 8 up, 8 in 2024-09-11T08:28:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:33 smithi175 ceph-mon[32813]: osdmap e442: 8 total, 8 up, 8 in 2024-09-11T08:28:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:33 smithi175 ceph-mon[32813]: pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:33.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:33.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[40835]: osdmap e442: 8 total, 8 up, 8 in 2024-09-11T08:28:33.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[40835]: pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[29664]: osdmap e442: 8 total, 8 up, 8 in 2024-09-11T08:28:33.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:33 smithi173 ceph-mon[29664]: pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:34 smithi175 ceph-mon[32813]: osdmap e443: 8 total, 8 up, 8 in 2024-09-11T08:28:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:34 smithi173 ceph-mon[29664]: osdmap e443: 8 total, 8 up, 8 in 2024-09-11T08:28:34.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:34 smithi173 ceph-mon[40835]: osdmap e443: 8 total, 8 up, 8 in 2024-09-11T08:28:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: osdmap e444: 8 total, 8 up, 8 in 2024-09-11T08:28:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:35 smithi175 ceph-mon[32813]: pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: osdmap e444: 8 total, 8 up, 8 in 2024-09-11T08:28:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[29664]: pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: osdmap e444: 8 total, 8 up, 8 in 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-83"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:35 smithi173 ceph-mon[40835]: pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:36.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:36 smithi175 ceph-mon[32813]: osdmap e445: 8 total, 8 up, 8 in 2024-09-11T08:28:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:36 smithi173 ceph-mon[29664]: osdmap e445: 8 total, 8 up, 8 in 2024-09-11T08:28:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:36.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:36 smithi173 ceph-mon[40835]: osdmap e445: 8 total, 8 up, 8 in 2024-09-11T08:28:36.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:37 smithi175 ceph-mon[32813]: osdmap e446: 8 total, 8 up, 8 in 2024-09-11T08:28:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:37 smithi175 ceph-mon[32813]: pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:37] "GET /metrics HTTP/1.1" 200 228655 "" "Prometheus/2.43.0" 2024-09-11T08:28:37.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[40835]: osdmap e446: 8 total, 8 up, 8 in 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[40835]: pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[29664]: osdmap e446: 8 total, 8 up, 8 in 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:37 smithi173 ceph-mon[29664]: pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: osdmap e447: 8 total, 8 up, 8 in 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:38.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: osdmap e448: 8 total, 8 up, 8 in 2024-09-11T08:28:38.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:38.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: osdmap e447: 8 total, 8 up, 8 in 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: osdmap e448: 8 total, 8 up, 8 in 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: osdmap e447: 8 total, 8 up, 8 in 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: osdmap e448: 8 total, 8 up, 8 in 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:38.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:39 smithi175 ceph-mon[32813]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:39 smithi175 ceph-mon[32813]: osdmap e449: 8 total, 8 up, 8 in 2024-09-11T08:28:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[29664]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[29664]: osdmap e449: 8 total, 8 up, 8 in 2024-09-11T08:28:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[40835]: pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-11T08:28:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_tier","val": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:28:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:39 smithi173 ceph-mon[40835]: osdmap e449: 8 total, 8 up, 8 in 2024-09-11T08:28:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:40.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:40.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:41 smithi175 ceph-mon[32813]: osdmap e450: 8 total, 8 up, 8 in 2024-09-11T08:28:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:41 smithi175 ceph-mon[32813]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[29664]: osdmap e450: 8 total, 8 up, 8 in 2024-09-11T08:28:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[29664]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[40835]: osdmap e450: 8 total, 8 up, 8 in 2024-09-11T08:28:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:41 smithi173 ceph-mon[40835]: pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:42.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:42 smithi175 ceph-mon[32813]: osdmap e451: 8 total, 8 up, 8 in 2024-09-11T08:28:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:42 smithi173 ceph-mon[29664]: osdmap e451: 8 total, 8 up, 8 in 2024-09-11T08:28:42.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:42 smithi173 ceph-mon[40835]: osdmap e451: 8 total, 8 up, 8 in 2024-09-11T08:28:43.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:43 smithi175 ceph-mon[32813]: osdmap e452: 8 total, 8 up, 8 in 2024-09-11T08:28:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:43 smithi175 ceph-mon[32813]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:43 smithi173 ceph-mon[29664]: osdmap e452: 8 total, 8 up, 8 in 2024-09-11T08:28:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:43 smithi173 ceph-mon[29664]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:43.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:43 smithi173 ceph-mon[40835]: osdmap e452: 8 total, 8 up, 8 in 2024-09-11T08:28:43.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:43 smithi173 ceph-mon[40835]: pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:44 smithi175 ceph-mon[32813]: osdmap e453: 8 total, 8 up, 8 in 2024-09-11T08:28:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[29664]: osdmap e453: 8 total, 8 up, 8 in 2024-09-11T08:28:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[40835]: osdmap e453: 8 total, 8 up, 8 in 2024-09-11T08:28:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-85"}]: dispatch 2024-09-11T08:28:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:45 smithi175 ceph-mon[32813]: osdmap e454: 8 total, 8 up, 8 in 2024-09-11T08:28:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:45 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:45 smithi175 ceph-mon[32813]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[29664]: osdmap e454: 8 total, 8 up, 8 in 2024-09-11T08:28:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[29664]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[40835]: osdmap e454: 8 total, 8 up, 8 in 2024-09-11T08:28:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:45 smithi173 ceph-mon[40835]: pgmap v701: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:46.575 INFO:tasks.workunit.client.0.smithi173.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18105 ms) 2024-09-11T08:28:46.575 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-11T08:28:46.575 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22538 ms) 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3039 ms) 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3021 ms) 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3031 ms) 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3026 ms) 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.576 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4017 ms) 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38247 ms) 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16636 ms) 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4027 ms) 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3017 ms) 2024-09-11T08:28:46.577 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24981 ms) 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (14985 ms) 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5034 ms) 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4024 ms) 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.578 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: waiting for scrubs... 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: done waiting 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24952 ms) 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10075 ms) 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9065 ms) 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9065 ms) 2024-09-11T08:28:46.579 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T08:28:46.580 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:46 smithi175 ceph-mon[32813]: osdmap e455: 8 total, 8 up, 8 in 2024-09-11T08:28:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[40835]: osdmap e455: 8 total, 8 up, 8 in 2024-09-11T08:28:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[29664]: osdmap e455: 8 total, 8 up, 8 in 2024-09-11T08:28:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:47 smithi175 ceph-mon[32813]: osdmap e456: 8 total, 8 up, 8 in 2024-09-11T08:28:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:47 smithi175 ceph-mon[32813]: pgmap v704: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:47] "GET /metrics HTTP/1.1" 200 228655 "" "Prometheus/2.43.0" 2024-09-11T08:28:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[29664]: osdmap e456: 8 total, 8 up, 8 in 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[29664]: pgmap v704: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[40835]: osdmap e456: 8 total, 8 up, 8 in 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:47 smithi173 ceph-mon[40835]: pgmap v704: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[29664]: osdmap e457: 8 total, 8 up, 8 in 2024-09-11T08:28:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[40835]: osdmap e457: 8 total, 8 up, 8 in 2024-09-11T08:28:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:49.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:48 smithi175 ceph-mon[32813]: osdmap e457: 8 total, 8 up, 8 in 2024-09-11T08:28:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[29664]: osdmap e458: 8 total, 8 up, 8 in 2024-09-11T08:28:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[29664]: pgmap v707: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[40835]: osdmap e458: 8 total, 8 up, 8 in 2024-09-11T08:28:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:49.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:49 smithi173 ceph-mon[40835]: pgmap v707: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:49 smithi175 ceph-mon[32813]: osdmap e458: 8 total, 8 up, 8 in 2024-09-11T08:28:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]: dispatch 2024-09-11T08:28:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:49 smithi175 ceph-mon[32813]: pgmap v707: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T08:28:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]': finished 2024-09-11T08:28:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: osdmap e459: 8 total, 8 up, 8 in 2024-09-11T08:28:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]': finished 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: osdmap e459: 8 total, 8 up, 8 in 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_tier","val": "test-rados-api-smithi173-80673-89-test-flush"}]': finished 2024-09-11T08:28:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: osdmap e459: 8 total, 8 up, 8 in 2024-09-11T08:28:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:28:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:28:51.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[29664]: osdmap e460: 8 total, 8 up, 8 in 2024-09-11T08:28:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[29664]: pgmap v710: 260 pgs: 260 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[40835]: osdmap e460: 8 total, 8 up, 8 in 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:51 smithi173 ceph-mon[40835]: pgmap v710: 260 pgs: 260 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:28:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:51 smithi175 ceph-mon[32813]: osdmap e460: 8 total, 8 up, 8 in 2024-09-11T08:28:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:28:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:51 smithi175 ceph-mon[32813]: pgmap v710: 260 pgs: 260 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:52 smithi173 ceph-mon[29664]: osdmap e461: 8 total, 8 up, 8 in 2024-09-11T08:28:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:52 smithi173 ceph-mon[40835]: osdmap e461: 8 total, 8 up, 8 in 2024-09-11T08:28:52.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:28:52.995 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:52 smithi175 ceph-mon[32813]: osdmap e461: 8 total, 8 up, 8 in 2024-09-11T08:28:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: osdmap e462: 8 total, 8 up, 8 in 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[29664]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: osdmap e462: 8 total, 8 up, 8 in 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:53 smithi173 ceph-mon[40835]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: osdmap e462: 8 total, 8 up, 8 in 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-87"}]: dispatch 2024-09-11T08:28:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:53 smithi175 ceph-mon[32813]: pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:28:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:54 smithi173 ceph-mon[29664]: osdmap e463: 8 total, 8 up, 8 in 2024-09-11T08:28:54.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:54 smithi173 ceph-mon[40835]: osdmap e463: 8 total, 8 up, 8 in 2024-09-11T08:28:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:54 smithi175 ceph-mon[32813]: osdmap e463: 8 total, 8 up, 8 in 2024-09-11T08:28:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:28:55.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[40835]: osdmap e464: 8 total, 8 up, 8 in 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[40835]: pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[29664]: osdmap e464: 8 total, 8 up, 8 in 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:55 smithi173 ceph-mon[29664]: pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-mon[32813]: osdmap e464: 8 total, 8 up, 8 in 2024-09-11T08:28:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:28:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:28:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:55 smithi175 ceph-mon[32813]: pgmap v716: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:28:56.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: osdmap e465: 8 total, 8 up, 8 in 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: osdmap e465: 8 total, 8 up, 8 in 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:56.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: osdmap e465: 8 total, 8 up, 8 in 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:28:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:28:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:28:57] "GET /metrics HTTP/1.1" 200 231082 "" "Prometheus/2.43.0" 2024-09-11T08:28:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[29664]: osdmap e466: 8 total, 8 up, 8 in 2024-09-11T08:28:57.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[29664]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:28:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[40835]: osdmap e466: 8 total, 8 up, 8 in 2024-09-11T08:28:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:57 smithi173 ceph-mon[40835]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:28:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:28:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:57 smithi175 ceph-mon[32813]: osdmap e466: 8 total, 8 up, 8 in 2024-09-11T08:28:58.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:57 smithi175 ceph-mon[32813]: pgmap v719: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:28:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:58 smithi173 ceph-mon[29664]: osdmap e467: 8 total, 8 up, 8 in 2024-09-11T08:28:58.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:58 smithi173 ceph-mon[40835]: osdmap e467: 8 total, 8 up, 8 in 2024-09-11T08:28:59.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:58 smithi175 ceph-mon[32813]: osdmap e467: 8 total, 8 up, 8 in 2024-09-11T08:28:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: osdmap e468: 8 total, 8 up, 8 in 2024-09-11T08:28:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:28:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[29664]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: osdmap e468: 8 total, 8 up, 8 in 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:28:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:28:59 smithi173 ceph-mon[40835]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: osdmap e468: 8 total, 8 up, 8 in 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-90"}]: dispatch 2024-09-11T08:29:00.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:28:59 smithi175 ceph-mon[32813]: pgmap v722: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T08:29:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:00 smithi173 ceph-mon[29664]: osdmap e469: 8 total, 8 up, 8 in 2024-09-11T08:29:00.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:00 smithi173 ceph-mon[40835]: osdmap e469: 8 total, 8 up, 8 in 2024-09-11T08:29:01.096 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:00 smithi175 ceph-mon[32813]: osdmap e469: 8 total, 8 up, 8 in 2024-09-11T08:29:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[29664]: osdmap e470: 8 total, 8 up, 8 in 2024-09-11T08:29:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[29664]: pgmap v725: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[40835]: osdmap e470: 8 total, 8 up, 8 in 2024-09-11T08:29:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:01 smithi173 ceph-mon[40835]: pgmap v725: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:01 smithi175 ceph-mon[32813]: osdmap e470: 8 total, 8 up, 8 in 2024-09-11T08:29:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:02.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:01 smithi175 ceph-mon[32813]: pgmap v725: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[29664]: osdmap e471: 8 total, 8 up, 8 in 2024-09-11T08:29:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[40835]: osdmap e471: 8 total, 8 up, 8 in 2024-09-11T08:29:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:02 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:02 smithi175 ceph-mon[32813]: osdmap e471: 8 total, 8 up, 8 in 2024-09-11T08:29:03.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:03 smithi173 ceph-mon[29664]: osdmap e472: 8 total, 8 up, 8 in 2024-09-11T08:29:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:03 smithi173 ceph-mon[29664]: pgmap v728: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:03 smithi173 ceph-mon[40835]: osdmap e472: 8 total, 8 up, 8 in 2024-09-11T08:29:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:03 smithi173 ceph-mon[40835]: pgmap v728: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:03 smithi175 ceph-mon[32813]: osdmap e472: 8 total, 8 up, 8 in 2024-09-11T08:29:04.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:03 smithi175 ceph-mon[32813]: pgmap v728: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-11T08:29:05.075 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: osdmap e473: 8 total, 8 up, 8 in 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:29:05.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:29:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: osdmap e473: 8 total, 8 up, 8 in 2024-09-11T08:29:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: osdmap e473: 8 total, 8 up, 8 in 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-92"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:29:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:29:05.219 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:29:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi175 to 3248M 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: Adjusting osd_memory_target on smithi173 to 3248M 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: osdmap e474: 8 total, 8 up, 8 in 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:05 smithi175 ceph-mon[32813]: pgmap v731: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi175 to 3248M 2024-09-11T08:29:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: Adjusting osd_memory_target on smithi173 to 3248M 2024-09-11T08:29:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: osdmap e474: 8 total, 8 up, 8 in 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[29664]: pgmap v731: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi175 to 3248M 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: Adjusting osd_memory_target on smithi173 to 3248M 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: osdmap e474: 8 total, 8 up, 8 in 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:05 smithi173 ceph-mon[40835]: pgmap v731: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:06.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:06 smithi175 ceph-mon[32813]: osdmap e475: 8 total, 8 up, 8 in 2024-09-11T08:29:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[29664]: osdmap e475: 8 total, 8 up, 8 in 2024-09-11T08:29:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[40835]: osdmap e475: 8 total, 8 up, 8 in 2024-09-11T08:29:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[29664]: osdmap e476: 8 total, 8 up, 8 in 2024-09-11T08:29:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[29664]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:07.967 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:07] "GET /metrics HTTP/1.1" 200 226243 "" "Prometheus/2.43.0" 2024-09-11T08:29:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[40835]: osdmap e476: 8 total, 8 up, 8 in 2024-09-11T08:29:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:07.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:07 smithi173 ceph-mon[40835]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:07 smithi175 ceph-mon[32813]: osdmap e476: 8 total, 8 up, 8 in 2024-09-11T08:29:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:07 smithi175 ceph-mon[32813]: pgmap v734: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:08 smithi175 ceph-mon[32813]: osdmap e477: 8 total, 8 up, 8 in 2024-09-11T08:29:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:08 smithi173 ceph-mon[29664]: osdmap e477: 8 total, 8 up, 8 in 2024-09-11T08:29:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:08 smithi173 ceph-mon[40835]: osdmap e477: 8 total, 8 up, 8 in 2024-09-11T08:29:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:09 smithi175 ceph-mon[32813]: osdmap e478: 8 total, 8 up, 8 in 2024-09-11T08:29:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:09 smithi175 ceph-mon[32813]: pgmap v737: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:09 smithi173 ceph-mon[29664]: osdmap e478: 8 total, 8 up, 8 in 2024-09-11T08:29:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:09 smithi173 ceph-mon[29664]: pgmap v737: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:09 smithi173 ceph-mon[40835]: osdmap e478: 8 total, 8 up, 8 in 2024-09-11T08:29:10.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:09 smithi173 ceph-mon[40835]: pgmap v737: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-11T08:29:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:10 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:10 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:11.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:10 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:29:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:11 smithi175 ceph-mon[32813]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:29:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:11 smithi173 ceph-mon[29664]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:29:12.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:11 smithi173 ceph-mon[40835]: pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T08:29:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:14 smithi173 ceph-mon[29664]: pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T08:29:14.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:14 smithi173 ceph-mon[40835]: pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T08:29:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:14 smithi175 ceph-mon[32813]: pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T08:29:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:16.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:16 smithi175 ceph-mon[32813]: pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-11T08:29:16.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:16 smithi173 ceph-mon[29664]: pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-11T08:29:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:16 smithi173 ceph-mon[40835]: pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-11T08:29:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:17.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:17] "GET /metrics HTTP/1.1" 200 226243 "" "Prometheus/2.43.0" 2024-09-11T08:29:17.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:18 smithi173 ceph-mon[29664]: pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 856 B/s wr, 3 op/s 2024-09-11T08:29:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:18 smithi173 ceph-mon[40835]: pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 856 B/s wr, 3 op/s 2024-09-11T08:29:18.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:18 smithi175 ceph-mon[32813]: pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 856 B/s wr, 3 op/s 2024-09-11T08:29:19.344 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:29:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore.transactions t=2024-09-11T08:29:18.996831485Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-11T08:29:19.344 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:29:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=cleanup t=2024-09-11T08:29:18.999331194Z level=info msg="Completed cleanup jobs" duration=12.936306ms 2024-09-11T08:29:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[29664]: pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 776 B/s wr, 3 op/s 2024-09-11T08:29:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[29664]: osdmap e479: 8 total, 8 up, 8 in 2024-09-11T08:29:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[40835]: pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 776 B/s wr, 3 op/s 2024-09-11T08:29:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[40835]: osdmap e479: 8 total, 8 up, 8 in 2024-09-11T08:29:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:20.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:20 smithi175 ceph-mon[32813]: pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 776 B/s wr, 3 op/s 2024-09-11T08:29:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:20 smithi175 ceph-mon[32813]: osdmap e479: 8 total, 8 up, 8 in 2024-09-11T08:29:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:21 smithi173 ceph-mon[29664]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:21.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:21 smithi173 ceph-mon[40835]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:21 smithi175 ceph-mon[32813]: pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:24.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:24 smithi173 ceph-mon[29664]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:24.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:24 smithi173 ceph-mon[40835]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:24 smithi175 ceph-mon[32813]: pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:26.320 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:25 smithi175 ceph-mon[32813]: osdmap e480: 8 total, 8 up, 8 in 2024-09-11T08:29:26.321 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:25 smithi175 ceph-mon[32813]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:26.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:25 smithi173 ceph-mon[29664]: osdmap e480: 8 total, 8 up, 8 in 2024-09-11T08:29:26.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:25 smithi173 ceph-mon[29664]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:26.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:25 smithi173 ceph-mon[40835]: osdmap e480: 8 total, 8 up, 8 in 2024-09-11T08:29:26.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:25 smithi173 ceph-mon[40835]: pgmap v747: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:26.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:27.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:27.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:27] "GET /metrics HTTP/1.1" 200 228640 "" "Prometheus/2.43.0" 2024-09-11T08:29:28.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:27 smithi175 ceph-mon[32813]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:28.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:27 smithi173 ceph-mon[29664]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:28.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:27 smithi173 ceph-mon[40835]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[29664]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[40835]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:30 smithi175 ceph-mon[32813]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:29:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-94"}]: dispatch 2024-09-11T08:29:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:31 smithi173 ceph-mon[29664]: osdmap e481: 8 total, 8 up, 8 in 2024-09-11T08:29:31.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:31 smithi173 ceph-mon[40835]: osdmap e481: 8 total, 8 up, 8 in 2024-09-11T08:29:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:31 smithi175 ceph-mon[32813]: osdmap e481: 8 total, 8 up, 8 in 2024-09-11T08:29:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[29664]: pgmap v751: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[29664]: osdmap e482: 8 total, 8 up, 8 in 2024-09-11T08:29:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:32.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[40835]: pgmap v751: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[40835]: osdmap e482: 8 total, 8 up, 8 in 2024-09-11T08:29:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:32.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:32 smithi175 ceph-mon[32813]: pgmap v751: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:32 smithi175 ceph-mon[32813]: osdmap e482: 8 total, 8 up, 8 in 2024-09-11T08:29:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[29664]: osdmap e483: 8 total, 8 up, 8 in 2024-09-11T08:29:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[29664]: pgmap v754: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[40835]: osdmap e483: 8 total, 8 up, 8 in 2024-09-11T08:29:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:33 smithi173 ceph-mon[40835]: pgmap v754: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:33 smithi175 ceph-mon[32813]: osdmap e483: 8 total, 8 up, 8 in 2024-09-11T08:29:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:29:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:33 smithi175 ceph-mon[32813]: pgmap v754: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:34 smithi173 ceph-mon[29664]: osdmap e484: 8 total, 8 up, 8 in 2024-09-11T08:29:34.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:34 smithi173 ceph-mon[40835]: osdmap e484: 8 total, 8 up, 8 in 2024-09-11T08:29:34.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:34 smithi175 ceph-mon[32813]: osdmap e484: 8 total, 8 up, 8 in 2024-09-11T08:29:35.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:35 smithi173 ceph-mon[29664]: pgmap v756: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 207 B/s wr, 1 op/s 2024-09-11T08:29:35.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:35.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:35 smithi173 ceph-mon[40835]: pgmap v756: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 207 B/s wr, 1 op/s 2024-09-11T08:29:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:35 smithi175 ceph-mon[32813]: pgmap v756: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 207 B/s wr, 1 op/s 2024-09-11T08:29:36.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:36 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:36.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:36 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:36 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:37 smithi173 ceph-mon[29664]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:29:37.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:37] "GET /metrics HTTP/1.1" 200 228599 "" "Prometheus/2.43.0" 2024-09-11T08:29:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:37 smithi173 ceph-mon[40835]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:29:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:37 smithi175 ceph-mon[32813]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 2 op/s 2024-09-11T08:29:40.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:40 smithi173 ceph-mon[29664]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 645 B/s rd, 645 B/s wr, 2 op/s 2024-09-11T08:29:40.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:40 smithi173 ceph-mon[40835]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 645 B/s rd, 645 B/s wr, 2 op/s 2024-09-11T08:29:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:40 smithi175 ceph-mon[32813]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 645 B/s rd, 645 B/s wr, 2 op/s 2024-09-11T08:29:42.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:42 smithi173 ceph-mon[29664]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 573 B/s wr, 2 op/s 2024-09-11T08:29:42.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:42 smithi173 ceph-mon[40835]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 573 B/s wr, 2 op/s 2024-09-11T08:29:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:42 smithi175 ceph-mon[32813]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 573 B/s wr, 2 op/s 2024-09-11T08:29:43.716 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:29:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:29:43.426+0000 7f64b286d640 -1 snap_mapper.add_oid found existing snaps mapped on 61:55f5a696:test-rados-api-smithi173-80673-97::foo:31, removing 2024-09-11T08:29:43.844 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:29:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:29:43.426+0000 7f5bb31b6640 -1 snap_mapper.add_oid found existing snaps mapped on 61:55f5a696:test-rados-api-smithi173-80673-97::foo:31, removing 2024-09-11T08:29:43.844 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:29:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:29:43.426+0000 7fbab1600640 -1 snap_mapper.add_oid found existing snaps mapped on 61:55f5a696:test-rados-api-smithi173-80673-97::foo:31, removing 2024-09-11T08:29:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[29664]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:29:44.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[40835]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:44.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:44.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:44 smithi175 ceph-mon[32813]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:29:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-96"}]: dispatch 2024-09-11T08:29:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:45 smithi173 ceph-mon[29664]: osdmap e485: 8 total, 8 up, 8 in 2024-09-11T08:29:45.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:45 smithi173 ceph-mon[29664]: pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-09-11T08:29:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:45 smithi173 ceph-mon[40835]: osdmap e485: 8 total, 8 up, 8 in 2024-09-11T08:29:45.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:45 smithi173 ceph-mon[40835]: pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-09-11T08:29:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:45 smithi175 ceph-mon[32813]: osdmap e485: 8 total, 8 up, 8 in 2024-09-11T08:29:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:45 smithi175 ceph-mon[32813]: pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-09-11T08:29:46.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:46 smithi175 ceph-mon[32813]: osdmap e486: 8 total, 8 up, 8 in 2024-09-11T08:29:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:46 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[29664]: osdmap e486: 8 total, 8 up, 8 in 2024-09-11T08:29:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[40835]: osdmap e486: 8 total, 8 up, 8 in 2024-09-11T08:29:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:46 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:47.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:47] "GET /metrics HTTP/1.1" 200 228599 "" "Prometheus/2.43.0" 2024-09-11T08:29:47.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[40835]: osdmap e487: 8 total, 8 up, 8 in 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[40835]: pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[29664]: osdmap e487: 8 total, 8 up, 8 in 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:47 smithi173 ceph-mon[29664]: pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:29:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:47 smithi175 ceph-mon[32813]: osdmap e487: 8 total, 8 up, 8 in 2024-09-11T08:29:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:47 smithi175 ceph-mon[32813]: pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:29:48.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[29664]: osdmap e488: 8 total, 8 up, 8 in 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[40835]: osdmap e488: 8 total, 8 up, 8 in 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:48.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:29:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:48 smithi175 ceph-mon[32813]: osdmap e488: 8 total, 8 up, 8 in 2024-09-11T08:29:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]: dispatch 2024-09-11T08:29:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:29:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]': finished 2024-09-11T08:29:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: osdmap e489: 8 total, 8 up, 8 in 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[29664]: pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]': finished 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: osdmap e489: 8 total, 8 up, 8 in 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:49 smithi173 ceph-mon[40835]: pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-98", "mode": "writeback"}]': finished 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: osdmap e489: 8 total, 8 up, 8 in 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:49 smithi175 ceph-mon[32813]: pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: osdmap e490: 8 total, 8 up, 8 in 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: osdmap e490: 8 total, 8 up, 8 in 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: osdmap e490: 8 total, 8 up, 8 in 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:29:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:29:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:29:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:29:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: osdmap e491: 8 total, 8 up, 8 in 2024-09-11T08:29:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[29664]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: osdmap e491: 8 total, 8 up, 8 in 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:51 smithi173 ceph-mon[40835]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: osdmap e491: 8 total, 8 up, 8 in 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]: dispatch 2024-09-11T08:29:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:51 smithi175 ceph-mon[32813]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:52.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]': finished 2024-09-11T08:29:52.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[40835]: osdmap e492: 8 total, 8 up, 8 in 2024-09-11T08:29:52.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]': finished 2024-09-11T08:29:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[29664]: osdmap e492: 8 total, 8 up, 8 in 2024-09-11T08:29:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:52.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_count","val": "1"}]': finished 2024-09-11T08:29:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:52 smithi175 ceph-mon[32813]: osdmap e492: 8 total, 8 up, 8 in 2024-09-11T08:29:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:52.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:29:53.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[40835]: osdmap e493: 8 total, 8 up, 8 in 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[40835]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[29664]: osdmap e493: 8 total, 8 up, 8 in 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:53 smithi173 ceph-mon[29664]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:29:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:53 smithi175 ceph-mon[32813]: osdmap e493: 8 total, 8 up, 8 in 2024-09-11T08:29:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]: dispatch 2024-09-11T08:29:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:53 smithi175 ceph-mon[32813]: pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:29:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]': finished 2024-09-11T08:29:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[29664]: osdmap e494: 8 total, 8 up, 8 in 2024-09-11T08:29:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:54.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]': finished 2024-09-11T08:29:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[40835]: osdmap e494: 8 total, 8 up, 8 in 2024-09-11T08:29:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:54.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-98","var": "target_max_objects","val": "250"}]': finished 2024-09-11T08:29:54.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:54 smithi175 ceph-mon[32813]: osdmap e494: 8 total, 8 up, 8 in 2024-09-11T08:29:54.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:54.745 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:29:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:29:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:29:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-mon[32813]: osdmap e495: 8 total, 8 up, 8 in 2024-09-11T08:29:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:55 smithi175 ceph-mon[32813]: pgmap v777: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:29:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[29664]: osdmap e495: 8 total, 8 up, 8 in 2024-09-11T08:29:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[29664]: pgmap v777: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:29:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[40835]: osdmap e495: 8 total, 8 up, 8 in 2024-09-11T08:29:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]: dispatch 2024-09-11T08:29:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:55 smithi173 ceph-mon[40835]: pgmap v777: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:29:56.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:29:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:29:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:56 smithi175 ceph-mon[32813]: osdmap e496: 8 total, 8 up, 8 in 2024-09-11T08:29:56.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:56 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[29664]: osdmap e496: 8 total, 8 up, 8 in 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-98"}]': finished 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[40835]: osdmap e496: 8 total, 8 up, 8 in 2024-09-11T08:29:56.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:56 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:29:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:57 smithi175 ceph-mon[32813]: osdmap e497: 8 total, 8 up, 8 in 2024-09-11T08:29:57.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:57 smithi175 ceph-mon[32813]: pgmap v780: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:29:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:57 smithi173 ceph-mon[29664]: osdmap e497: 8 total, 8 up, 8 in 2024-09-11T08:29:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:57 smithi173 ceph-mon[29664]: pgmap v780: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:29:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:29:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:29:57] "GET /metrics HTTP/1.1" 200 228598 "" "Prometheus/2.43.0" 2024-09-11T08:29:57.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:57 smithi173 ceph-mon[40835]: osdmap e497: 8 total, 8 up, 8 in 2024-09-11T08:29:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:57 smithi173 ceph-mon[40835]: pgmap v780: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:29:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:58 smithi175 ceph-mon[32813]: osdmap e498: 8 total, 8 up, 8 in 2024-09-11T08:29:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[29664]: osdmap e498: 8 total, 8 up, 8 in 2024-09-11T08:29:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:58.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[40835]: osdmap e498: 8 total, 8 up, 8 in 2024-09-11T08:29:58.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:58.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:29:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:59 smithi175 ceph-mon[32813]: osdmap e499: 8 total, 8 up, 8 in 2024-09-11T08:29:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:29:59 smithi175 ceph-mon[32813]: pgmap v783: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:29:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[29664]: osdmap e499: 8 total, 8 up, 8 in 2024-09-11T08:29:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[29664]: pgmap v783: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[40835]: osdmap e499: 8 total, 8 up, 8 in 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:29:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:29:59 smithi173 ceph-mon[40835]: pgmap v783: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: osdmap e500: 8 total, 8 up, 8 in 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-11T08:30:00.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:00 smithi175 ceph-mon[32813]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: osdmap e500: 8 total, 8 up, 8 in 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[29664]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: osdmap e500: 8 total, 8 up, 8 in 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-09-11T08:30:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:00 smithi173 ceph-mon[40835]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-11T08:30:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:01 smithi175 ceph-mon[32813]: osdmap e501: 8 total, 8 up, 8 in 2024-09-11T08:30:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:01 smithi175 ceph-mon[32813]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[29664]: osdmap e501: 8 total, 8 up, 8 in 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[29664]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-6", "overlaypool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[40835]: osdmap e501: 8 total, 8 up, 8 in 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]: dispatch 2024-09-11T08:30:01.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:01 smithi173 ceph-mon[40835]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:02 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]': finished 2024-09-11T08:30:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:02 smithi175 ceph-mon[32813]: osdmap e502: 8 total, 8 up, 8 in 2024-09-11T08:30:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:02.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:02.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]': finished 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[29664]: osdmap e502: 8 total, 8 up, 8 in 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:02.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-100", "mode": "writeback"}]': finished 2024-09-11T08:30:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[40835]: osdmap e502: 8 total, 8 up, 8 in 2024-09-11T08:30:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:02.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:03 smithi175 ceph-mon[32813]: osdmap e503: 8 total, 8 up, 8 in 2024-09-11T08:30:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:03 smithi175 ceph-mon[32813]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:03.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:03.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[40835]: osdmap e503: 8 total, 8 up, 8 in 2024-09-11T08:30:03.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[40835]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[29664]: osdmap e503: 8 total, 8 up, 8 in 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:03.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:03 smithi173 ceph-mon[29664]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:04 smithi175 ceph-mon[32813]: osdmap e504: 8 total, 8 up, 8 in 2024-09-11T08:30:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:04.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:04.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[40835]: osdmap e504: 8 total, 8 up, 8 in 2024-09-11T08:30:04.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:04.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:04.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[29664]: osdmap e504: 8 total, 8 up, 8 in 2024-09-11T08:30:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:04.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:05.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:05.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:05.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: osdmap e505: 8 total, 8 up, 8 in 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: pgmap v792: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[40835]: osdmap e506: 8 total, 8 up, 8 in 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: osdmap e505: 8 total, 8 up, 8 in 2024-09-11T08:30:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: pgmap v792: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-11T08:30:05.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:05 smithi173 ceph-mon[29664]: osdmap e506: 8 total, 8 up, 8 in 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: osdmap e505: 8 total, 8 up, 8 in 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:30:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: pgmap v792: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-09-11T08:30:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:05 smithi175 ceph-mon[32813]: osdmap e506: 8 total, 8 up, 8 in 2024-09-11T08:30:06.682 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:06.698 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.698 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.698 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:06 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:06.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:06 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:30:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:07 smithi175 ceph-mon[32813]: osdmap e507: 8 total, 8 up, 8 in 2024-09-11T08:30:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:07 smithi175 ceph-mon[32813]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:30:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:07] "GET /metrics HTTP/1.1" 200 228643 "" "Prometheus/2.43.0" 2024-09-11T08:30:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[29664]: osdmap e507: 8 total, 8 up, 8 in 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[29664]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]': finished 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[40835]: osdmap e507: 8 total, 8 up, 8 in 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]: dispatch 2024-09-11T08:30:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:07 smithi173 ceph-mon[40835]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T08:30:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:08 smithi175 ceph-mon[32813]: osdmap e508: 8 total, 8 up, 8 in 2024-09-11T08:30:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:08 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:08 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:08.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:08.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[29664]: osdmap e508: 8 total, 8 up, 8 in 2024-09-11T08:30:08.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:08.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-100"}]': finished 2024-09-11T08:30:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[40835]: osdmap e508: 8 total, 8 up, 8 in 2024-09-11T08:30:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:08.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:08 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:09 smithi175 ceph-mon[32813]: osdmap e509: 8 total, 8 up, 8 in 2024-09-11T08:30:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:09 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:09 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:09 smithi175 ceph-mon[32813]: pgmap v798: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[29664]: osdmap e509: 8 total, 8 up, 8 in 2024-09-11T08:30:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[29664]: pgmap v798: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[40835]: osdmap e509: 8 total, 8 up, 8 in 2024-09-11T08:30:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:09.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:09 smithi173 ceph-mon[40835]: pgmap v798: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:10.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: osdmap e510: 8 total, 8 up, 8 in 2024-09-11T08:30:10.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:10.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: osdmap e510: 8 total, 8 up, 8 in 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:30:10.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: osdmap e510: 8 total, 8 up, 8 in 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:30:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:30:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: osdmap e511: 8 total, 8 up, 8 in 2024-09-11T08:30:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:30:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[29664]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: osdmap e511: 8 total, 8 up, 8 in 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:11.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:11 smithi173 ceph-mon[40835]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: osdmap e511: 8 total, 8 up, 8 in 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-09-11T08:30:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:11 smithi175 ceph-mon[32813]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:30:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[29664]: osdmap e512: 8 total, 8 up, 8 in 2024-09-11T08:30:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:30:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[40835]: osdmap e512: 8 total, 8 up, 8 in 2024-09-11T08:30:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-09-11T08:30:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:12 smithi175 ceph-mon[32813]: osdmap e512: 8 total, 8 up, 8 in 2024-09-11T08:30:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-09-11T08:30:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:30:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[29664]: osdmap e513: 8 total, 8 up, 8 in 2024-09-11T08:30:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[29664]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[40835]: osdmap e513: 8 total, 8 up, 8 in 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:13.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:13 smithi173 ceph-mon[40835]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-09-11T08:30:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:13 smithi175 ceph-mon[32813]: osdmap e513: 8 total, 8 up, 8 in 2024-09-11T08:30:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-09-11T08:30:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:13 smithi175 ceph-mon[32813]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:30:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: osdmap e514: 8 total, 8 up, 8 in 2024-09-11T08:30:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:14.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: osdmap e514: 8 total, 8 up, 8 in 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:14.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: osdmap e514: 8 total, 8 up, 8 in 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-6"}]: dispatch 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1621435546' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:15.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-6", "tierpool": "test-rados-api-smithi173-80673-102"}]: dispatch 2024-09-11T08:30:15.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:15 smithi173 ceph-mon[29664]: osdmap e515: 8 total, 8 up, 8 in 2024-09-11T08:30:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:15 smithi173 ceph-mon[29664]: pgmap v807: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:15.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:15 smithi173 ceph-mon[40835]: osdmap e515: 8 total, 8 up, 8 in 2024-09-11T08:30:15.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:15 smithi173 ceph-mon[40835]: pgmap v807: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:15 smithi175 ceph-mon[32813]: osdmap e515: 8 total, 8 up, 8 in 2024-09-11T08:30:16.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:15 smithi175 ceph-mon[32813]: pgmap v807: 196 pgs: 196 active+clean; 8.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:16.641 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:16.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: osdmap e516: 8 total, 8 up, 8 in 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: osdmap e516: 8 total, 8 up, 8 in 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:16.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:16.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:16.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:16 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: osdmap e516: 8 total, 8 up, 8 in 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:17.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:16 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[29664]: osdmap e517: 8 total, 8 up, 8 in 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[29664]: pgmap v810: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:17.880 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:17] "GET /metrics HTTP/1.1" 200 228643 "" "Prometheus/2.43.0" 2024-09-11T08:30:17.881 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:17.881 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[40835]: osdmap e517: 8 total, 8 up, 8 in 2024-09-11T08:30:17.881 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.881 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:17.881 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:17 smithi173 ceph-mon[40835]: pgmap v810: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:17 smithi175 ceph-mon[32813]: osdmap e517: 8 total, 8 up, 8 in 2024-09-11T08:30:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:18.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:17 smithi175 ceph-mon[32813]: pgmap v810: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:18.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:18 smithi173 ceph-mon[29664]: osdmap e518: 8 total, 8 up, 8 in 2024-09-11T08:30:18.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:18 smithi173 ceph-mon[40835]: osdmap e518: 8 total, 8 up, 8 in 2024-09-11T08:30:19.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:18 smithi175 ceph-mon[32813]: osdmap e518: 8 total, 8 up, 8 in 2024-09-11T08:30:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[29664]: osdmap e519: 8 total, 8 up, 8 in 2024-09-11T08:30:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[29664]: pgmap v813: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[40835]: osdmap e519: 8 total, 8 up, 8 in 2024-09-11T08:30:19.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:19 smithi173 ceph-mon[40835]: pgmap v813: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi173-80673-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:19 smithi175 ceph-mon[32813]: osdmap e519: 8 total, 8 up, 8 in 2024-09-11T08:30:20.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:19 smithi175 ceph-mon[32813]: pgmap v813: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[29664]: osdmap e520: 8 total, 8 up, 8 in 2024-09-11T08:30:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[40835]: osdmap e520: 8 total, 8 up, 8 in 2024-09-11T08:30:20.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:20 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:20 smithi175 ceph-mon[32813]: osdmap e520: 8 total, 8 up, 8 in 2024-09-11T08:30:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[29664]: osdmap e521: 8 total, 8 up, 8 in 2024-09-11T08:30:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:21.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[29664]: pgmap v816: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[40835]: osdmap e521: 8 total, 8 up, 8 in 2024-09-11T08:30:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:21.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:21 smithi173 ceph-mon[40835]: pgmap v816: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:21 smithi175 ceph-mon[32813]: osdmap e521: 8 total, 8 up, 8 in 2024-09-11T08:30:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:22.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:21 smithi175 ceph-mon[32813]: pgmap v816: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:22.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:22 smithi173 ceph-mon[29664]: osdmap e522: 8 total, 8 up, 8 in 2024-09-11T08:30:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:22.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:22 smithi173 ceph-mon[40835]: osdmap e522: 8 total, 8 up, 8 in 2024-09-11T08:30:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:23.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:22 smithi175 ceph-mon[32813]: osdmap e522: 8 total, 8 up, 8 in 2024-09-11T08:30:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: osdmap e523: 8 total, 8 up, 8 in 2024-09-11T08:30:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: pgmap v819: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: osdmap e524: 8 total, 8 up, 8 in 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: osdmap e523: 8 total, 8 up, 8 in 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: pgmap v819: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:23.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: osdmap e524: 8 total, 8 up, 8 in 2024-09-11T08:30:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:23.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: osdmap e523: 8 total, 8 up, 8 in 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: pgmap v819: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: osdmap e524: 8 total, 8 up, 8 in 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:24.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: osdmap e525: 8 total, 8 up, 8 in 2024-09-11T08:30:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[29664]: pgmap v822: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: osdmap e525: 8 total, 8 up, 8 in 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:25.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:25 smithi173 ceph-mon[40835]: pgmap v822: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: osdmap e525: 8 total, 8 up, 8 in 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:26.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:25 smithi175 ceph-mon[32813]: pgmap v822: 236 pgs: 32 unknown, 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:26.697 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[29664]: osdmap e526: 8 total, 8 up, 8 in 2024-09-11T08:30:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:26.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[40835]: osdmap e526: 8 total, 8 up, 8 in 2024-09-11T08:30:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:26.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:26 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:27.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-107", "overlaypool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-mon[32813]: osdmap e526: 8 total, 8 up, 8 in 2024-09-11T08:30:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:27.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:26 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:27] "GET /metrics HTTP/1.1" 200 226236 "" "Prometheus/2.43.0" 2024-09-11T08:30:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: osdmap e527: 8 total, 8 up, 8 in 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[29664]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: osdmap e527: 8 total, 8 up, 8 in 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:27 smithi173 ceph-mon[40835]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-107-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: osdmap e527: 8 total, 8 up, 8 in 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]: dispatch 2024-09-11T08:30:28.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:27 smithi175 ceph-mon[32813]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]': finished 2024-09-11T08:30:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[29664]: osdmap e528: 8 total, 8 up, 8 in 2024-09-11T08:30:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]': finished 2024-09-11T08:30:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[40835]: osdmap e528: 8 total, 8 up, 8 in 2024-09-11T08:30:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:28.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-107"}]': finished 2024-09-11T08:30:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:28 smithi175 ceph-mon[32813]: osdmap e528: 8 total, 8 up, 8 in 2024-09-11T08:30:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3580847441' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:29.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]: dispatch 2024-09-11T08:30:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:29 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:29 smithi175 ceph-mon[32813]: osdmap e529: 8 total, 8 up, 8 in 2024-09-11T08:30:30.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:29 smithi175 ceph-mon[32813]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[29664]: osdmap e529: 8 total, 8 up, 8 in 2024-09-11T08:30:30.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[29664]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-107", "tierpool": "test-rados-api-smithi173-80673-107-cache"}]': finished 2024-09-11T08:30:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[40835]: osdmap e529: 8 total, 8 up, 8 in 2024-09-11T08:30:30.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:29 smithi173 ceph-mon[40835]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:31.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:30 smithi175 ceph-mon[32813]: osdmap e530: 8 total, 8 up, 8 in 2024-09-11T08:30:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:30 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:30 smithi173 ceph-mon[29664]: osdmap e530: 8 total, 8 up, 8 in 2024-09-11T08:30:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:30 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:31.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:30 smithi173 ceph-mon[40835]: osdmap e530: 8 total, 8 up, 8 in 2024-09-11T08:30:31.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:30 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: osdmap e531: 8 total, 8 up, 8 in 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:31 smithi175 ceph-mon[32813]: pgmap v831: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: osdmap e531: 8 total, 8 up, 8 in 2024-09-11T08:30:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[29664]: pgmap v831: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: osdmap e531: 8 total, 8 up, 8 in 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:32.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:31 smithi173 ceph-mon[40835]: pgmap v831: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:32 smithi175 ceph-mon[32813]: osdmap e532: 8 total, 8 up, 8 in 2024-09-11T08:30:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[29664]: osdmap e532: 8 total, 8 up, 8 in 2024-09-11T08:30:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:33.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[40835]: osdmap e532: 8 total, 8 up, 8 in 2024-09-11T08:30:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:33 smithi175 ceph-mon[32813]: osdmap e533: 8 total, 8 up, 8 in 2024-09-11T08:30:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:33 smithi175 ceph-mon[32813]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:34.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:33 smithi173 ceph-mon[40835]: osdmap e533: 8 total, 8 up, 8 in 2024-09-11T08:30:34.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:33 smithi173 ceph-mon[40835]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:33 smithi173 ceph-mon[29664]: osdmap e533: 8 total, 8 up, 8 in 2024-09-11T08:30:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:33 smithi173 ceph-mon[29664]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:35.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:35.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:34 smithi175 ceph-mon[32813]: osdmap e534: 8 total, 8 up, 8 in 2024-09-11T08:30:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:34 smithi173 ceph-mon[29664]: osdmap e534: 8 total, 8 up, 8 in 2024-09-11T08:30:35.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:35.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:34 smithi173 ceph-mon[40835]: osdmap e534: 8 total, 8 up, 8 in 2024-09-11T08:30:35.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:36.070 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: osdmap e535: 8 total, 8 up, 8 in 2024-09-11T08:30:36.071 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.071 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:36.071 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.071 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: pgmap v837: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:36.071 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: osdmap e535: 8 total, 8 up, 8 in 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: pgmap v837: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: osdmap e535: 8 total, 8 up, 8 in 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: pgmap v837: 212 pgs: 40 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:36.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:36.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: osdmap e536: 8 total, 8 up, 8 in 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: osdmap e537: 8 total, 8 up, 8 in 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: osdmap e536: 8 total, 8 up, 8 in 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: osdmap e537: 8 total, 8 up, 8 in 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: osdmap e536: 8 total, 8 up, 8 in 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: osdmap e537: 8 total, 8 up, 8 in 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:37] "GET /metrics HTTP/1.1" 200 231066 "" "Prometheus/2.43.0" 2024-09-11T08:30:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: pgmap v840: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: osdmap e538: 8 total, 8 up, 8 in 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: pgmap v840: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: osdmap e538: 8 total, 8 up, 8 in 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: pgmap v840: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-109", "overlaypool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: osdmap e538: 8 total, 8 up, 8 in 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:38.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]: dispatch 2024-09-11T08:30:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:38 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:38 smithi175 ceph-mon[32813]: osdmap e539: 8 total, 8 up, 8 in 2024-09-11T08:30:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:39.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:39.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[29664]: osdmap e539: 8 total, 8 up, 8 in 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-109-cache", "mode": "writeback"}]': finished 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[40835]: osdmap e539: 8 total, 8 up, 8 in 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:39.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:30:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:39 smithi175 ceph-mon[32813]: pgmap v843: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:39 smithi175 ceph-mon[32813]: osdmap e540: 8 total, 8 up, 8 in 2024-09-11T08:30:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:40.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:40.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[29664]: pgmap v843: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:40.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[29664]: osdmap e540: 8 total, 8 up, 8 in 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[40835]: pgmap v843: 212 pgs: 22 creating+activating, 190 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[40835]: osdmap e540: 8 total, 8 up, 8 in 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:40.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:30:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:41 smithi175 ceph-mon[32813]: osdmap e541: 8 total, 8 up, 8 in 2024-09-11T08:30:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:41 smithi175 ceph-mon[32813]: pgmap v846: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[29664]: osdmap e541: 8 total, 8 up, 8 in 2024-09-11T08:30:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[29664]: pgmap v846: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:30:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[40835]: osdmap e541: 8 total, 8 up, 8 in 2024-09-11T08:30:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:30:42.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:41 smithi173 ceph-mon[40835]: pgmap v846: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:42 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:42 smithi175 ceph-mon[32813]: osdmap e542: 8 total, 8 up, 8 in 2024-09-11T08:30:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:43.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[29664]: osdmap e542: 8 total, 8 up, 8 in 2024-09-11T08:30:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:43.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:30:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:30:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[40835]: osdmap e542: 8 total, 8 up, 8 in 2024-09-11T08:30:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:43.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-09-11T08:30:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-11T08:30:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:43 smithi175 ceph-mon[32813]: osdmap e543: 8 total, 8 up, 8 in 2024-09-11T08:30:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:43 smithi175 ceph-mon[32813]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-11T08:30:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[29664]: osdmap e543: 8 total, 8 up, 8 in 2024-09-11T08:30:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[29664]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-09-11T08:30:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[40835]: osdmap e543: 8 total, 8 up, 8 in 2024-09-11T08:30:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:44.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:43 smithi173 ceph-mon[40835]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:44 smithi175 ceph-mon[32813]: osdmap e544: 8 total, 8 up, 8 in 2024-09-11T08:30:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[29664]: osdmap e544: 8 total, 8 up, 8 in 2024-09-11T08:30:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[40835]: osdmap e544: 8 total, 8 up, 8 in 2024-09-11T08:30:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]: dispatch 2024-09-11T08:30:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:45 smithi175 ceph-mon[32813]: osdmap e545: 8 total, 8 up, 8 in 2024-09-11T08:30:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:45 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:46.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:45 smithi175 ceph-mon[32813]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:46.117 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[29664]: osdmap e545: 8 total, 8 up, 8 in 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[29664]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-109", "tierpool": "test-rados-api-smithi173-80673-109-cache"}]': finished 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[40835]: osdmap e545: 8 total, 8 up, 8 in 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:46.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:45 smithi173 ceph-mon[40835]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:46.817 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:47.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:46 smithi175 ceph-mon[32813]: osdmap e546: 8 total, 8 up, 8 in 2024-09-11T08:30:47.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:46 smithi173 ceph-mon[29664]: osdmap e546: 8 total, 8 up, 8 in 2024-09-11T08:30:47.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:46 smithi173 ceph-mon[40835]: osdmap e546: 8 total, 8 up, 8 in 2024-09-11T08:30:47.818 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:47] "GET /metrics HTTP/1.1" 200 231066 "" "Prometheus/2.43.0" 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[29664]: osdmap e547: 8 total, 8 up, 8 in 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[29664]: pgmap v855: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:47.823 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[40835]: osdmap e547: 8 total, 8 up, 8 in 2024-09-11T08:30:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:47 smithi175 ceph-mon[32813]: osdmap e547: 8 total, 8 up, 8 in 2024-09-11T08:30:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:48.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:47 smithi175 ceph-mon[32813]: pgmap v855: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:48 smithi175 ceph-mon[32813]: osdmap e548: 8 total, 8 up, 8 in 2024-09-11T08:30:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:49.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:49.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:49.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[29664]: osdmap e548: 8 total, 8 up, 8 in 2024-09-11T08:30:49.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:49.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:47 smithi173 ceph-mon[40835]: pgmap v855: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[40835]: osdmap e548: 8 total, 8 up, 8 in 2024-09-11T08:30:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2226366844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:49.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]: dispatch 2024-09-11T08:30:50.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:50.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[40835]: osdmap e549: 8 total, 8 up, 8 in 2024-09-11T08:30:50.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[40835]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:50.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:50.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[29664]: osdmap e549: 8 total, 8 up, 8 in 2024-09-11T08:30:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[29664]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:50.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:49 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-109"}]': finished 2024-09-11T08:30:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:49 smithi175 ceph-mon[32813]: osdmap e549: 8 total, 8 up, 8 in 2024-09-11T08:30:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:49 smithi175 ceph-mon[32813]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:50.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:49 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:30:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[29664]: osdmap e550: 8 total, 8 up, 8 in 2024-09-11T08:30:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[40835]: osdmap e550: 8 total, 8 up, 8 in 2024-09-11T08:30:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:50 smithi175 ceph-mon[32813]: osdmap e550: 8 total, 8 up, 8 in 2024-09-11T08:30:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:51.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[29664]: osdmap e551: 8 total, 8 up, 8 in 2024-09-11T08:30:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[29664]: pgmap v861: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[40835]: osdmap e551: 8 total, 8 up, 8 in 2024-09-11T08:30:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:51 smithi173 ceph-mon[40835]: pgmap v861: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:51 smithi175 ceph-mon[32813]: osdmap e551: 8 total, 8 up, 8 in 2024-09-11T08:30:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/650448341' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]: dispatch 2024-09-11T08:30:52.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:51 smithi175 ceph-mon[32813]: pgmap v861: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:53.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:53.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: osdmap e552: 8 total, 8 up, 8 in 2024-09-11T08:30:53.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: osdmap e552: 8 total, 8 up, 8 in 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:53.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi173-80673-104"}]': finished 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: osdmap e552: 8 total, 8 up, 8 in 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:53.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T08:30:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[29664]: osdmap e553: 8 total, 8 up, 8 in 2024-09-11T08:30:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[29664]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[40835]: osdmap e553: 8 total, 8 up, 8 in 2024-09-11T08:30:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:53 smithi173 ceph-mon[40835]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi173-80673-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-11T08:30:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:53 smithi175 ceph-mon[32813]: osdmap e553: 8 total, 8 up, 8 in 2024-09-11T08:30:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:30:54.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:53 smithi175 ceph-mon[32813]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-11T08:30:55.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:54 smithi173 ceph-mon[29664]: osdmap e554: 8 total, 8 up, 8 in 2024-09-11T08:30:55.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:54 smithi173 ceph-mon[40835]: osdmap e554: 8 total, 8 up, 8 in 2024-09-11T08:30:55.245 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:54 smithi175 ceph-mon[32813]: osdmap e554: 8 total, 8 up, 8 in 2024-09-11T08:30:55.245 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:30:56.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:30:56.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[29664]: osdmap e555: 8 total, 8 up, 8 in 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[29664]: pgmap v867: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[29664]: osdmap e556: 8 total, 8 up, 8 in 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[40835]: osdmap e555: 8 total, 8 up, 8 in 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[40835]: pgmap v867: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:56.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:55 smithi173 ceph-mon[40835]: osdmap e556: 8 total, 8 up, 8 in 2024-09-11T08:30:56.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi173-80673-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:30:56.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-mon[32813]: osdmap e555: 8 total, 8 up, 8 in 2024-09-11T08:30:56.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:30:56.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-mon[32813]: pgmap v867: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:30:56.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:55 smithi175 ceph-mon[32813]: osdmap e556: 8 total, 8 up, 8 in 2024-09-11T08:30:56.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:30:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:30:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[29664]: osdmap e557: 8 total, 8 up, 8 in 2024-09-11T08:30:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:57.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:56 smithi173 ceph-mon[40835]: osdmap e557: 8 total, 8 up, 8 in 2024-09-11T08:30:57.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:30:57.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:30:57.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:56 smithi175 ceph-mon[32813]: osdmap e557: 8 total, 8 up, 8 in 2024-09-11T08:30:57.902 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:30:57] "GET /metrics HTTP/1.1" 200 226237 "" "Prometheus/2.43.0" 2024-09-11T08:30:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: pgmap v870: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: osdmap e558: 8 total, 8 up, 8 in 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: pgmap v870: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:58.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: osdmap e558: 8 total, 8 up, 8 in 2024-09-11T08:30:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:30:58.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: pgmap v870: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: osdmap e558: 8 total, 8 up, 8 in 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:30:58.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:00.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:00.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[29664]: osdmap e559: 8 total, 8 up, 8 in 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[29664]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[40835]: osdmap e559: 8 total, 8 up, 8 in 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:30:59 smithi173 ceph-mon[40835]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:59 smithi175 ceph-mon[32813]: osdmap e559: 8 total, 8 up, 8 in 2024-09-11T08:31:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:00.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:30:59 smithi175 ceph-mon[32813]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[29664]: osdmap e560: 8 total, 8 up, 8 in 2024-09-11T08:31:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[40835]: osdmap e560: 8 total, 8 up, 8 in 2024-09-11T08:31:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:00 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:01.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:00 smithi175 ceph-mon[32813]: osdmap e560: 8 total, 8 up, 8 in 2024-09-11T08:31:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]: dispatch 2024-09-11T08:31:01.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:00 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:02.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[29664]: osdmap e561: 8 total, 8 up, 8 in 2024-09-11T08:31:02.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[29664]: pgmap v876: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:31:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[40835]: osdmap e561: 8 total, 8 up, 8 in 2024-09-11T08:31:02.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:01 smithi173 ceph-mon[40835]: pgmap v876: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:31:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-112"}]': finished 2024-09-11T08:31:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:01 smithi175 ceph-mon[32813]: osdmap e561: 8 total, 8 up, 8 in 2024-09-11T08:31:02.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:01 smithi175 ceph-mon[32813]: pgmap v876: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-11T08:31:03.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:02 smithi173 ceph-mon[29664]: osdmap e562: 8 total, 8 up, 8 in 2024-09-11T08:31:03.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:02 smithi173 ceph-mon[40835]: osdmap e562: 8 total, 8 up, 8 in 2024-09-11T08:31:03.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:02 smithi175 ceph-mon[32813]: osdmap e562: 8 total, 8 up, 8 in 2024-09-11T08:31:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[29664]: osdmap e563: 8 total, 8 up, 8 in 2024-09-11T08:31:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[29664]: pgmap v879: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[40835]: osdmap e563: 8 total, 8 up, 8 in 2024-09-11T08:31:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:03 smithi173 ceph-mon[40835]: pgmap v879: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:03 smithi175 ceph-mon[32813]: osdmap e563: 8 total, 8 up, 8 in 2024-09-11T08:31:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:04.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:03 smithi175 ceph-mon[32813]: pgmap v879: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: osdmap e564: 8 total, 8 up, 8 in 2024-09-11T08:31:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: osdmap e565: 8 total, 8 up, 8 in 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: osdmap e564: 8 total, 8 up, 8 in 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: osdmap e565: 8 total, 8 up, 8 in 2024-09-11T08:31:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:05.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: osdmap e564: 8 total, 8 up, 8 in 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: osdmap e565: 8 total, 8 up, 8 in 2024-09-11T08:31:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:05.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: osdmap e566: 8 total, 8 up, 8 in 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: osdmap e566: 8 total, 8 up, 8 in 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: osdmap e566: 8 total, 8 up, 8 in 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]: dispatch 2024-09-11T08:31:06.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:07.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]': finished 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[29664]: osdmap e567: 8 total, 8 up, 8 in 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]': finished 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[40835]: osdmap e567: 8 total, 8 up, 8 in 2024-09-11T08:31:07.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:07 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-114", "mode": "writeback"}]': finished 2024-09-11T08:31:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:07 smithi175 ceph-mon[32813]: osdmap e567: 8 total, 8 up, 8 in 2024-09-11T08:31:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:07] "GET /metrics HTTP/1.1" 200 228715 "" "Prometheus/2.43.0" 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: osdmap e568: 8 total, 8 up, 8 in 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:08.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: osdmap e568: 8 total, 8 up, 8 in 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:08.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: osdmap e568: 8 total, 8 up, 8 in 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]: dispatch 2024-09-11T08:31:09.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:09.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:09.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[40835]: osdmap e569: 8 total, 8 up, 8 in 2024-09-11T08:31:09.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:09.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:09.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:09 smithi173 ceph-mon[29664]: osdmap e569: 8 total, 8 up, 8 in 2024-09-11T08:31:09.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:09 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:09.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-114"}]': finished 2024-09-11T08:31:09.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:09 smithi175 ceph-mon[32813]: osdmap e569: 8 total, 8 up, 8 in 2024-09-11T08:31:10.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[29664]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:10.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:31:10.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[29664]: osdmap e570: 8 total, 8 up, 8 in 2024-09-11T08:31:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[40835]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:31:10.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:10 smithi173 ceph-mon[40835]: osdmap e570: 8 total, 8 up, 8 in 2024-09-11T08:31:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:10 smithi175 ceph-mon[32813]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:31:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:10 smithi175 ceph-mon[32813]: osdmap e570: 8 total, 8 up, 8 in 2024-09-11T08:31:11.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:11.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:31:11.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:31:11.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:11.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: osdmap e571: 8 total, 8 up, 8 in 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: osdmap e571: 8 total, 8 up, 8 in 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:11.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:11.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: osdmap e571: 8 total, 8 up, 8 in 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:12.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[40835]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:12.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:12.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[40835]: osdmap e572: 8 total, 8 up, 8 in 2024-09-11T08:31:12.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[29664]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:12.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:12.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:12 smithi173 ceph-mon[29664]: osdmap e572: 8 total, 8 up, 8 in 2024-09-11T08:31:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:12 smithi175 ceph-mon[32813]: pgmap v891: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:12 smithi175 ceph-mon[32813]: osdmap e572: 8 total, 8 up, 8 in 2024-09-11T08:31:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[29664]: osdmap e573: 8 total, 8 up, 8 in 2024-09-11T08:31:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[29664]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[40835]: osdmap e573: 8 total, 8 up, 8 in 2024-09-11T08:31:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:13 smithi173 ceph-mon[40835]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:14.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:13 smithi175 ceph-mon[32813]: osdmap e573: 8 total, 8 up, 8 in 2024-09-11T08:31:14.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:14.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:13 smithi175 ceph-mon[32813]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[29664]: osdmap e574: 8 total, 8 up, 8 in 2024-09-11T08:31:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[40835]: osdmap e574: 8 total, 8 up, 8 in 2024-09-11T08:31:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:14 smithi175 ceph-mon[32813]: osdmap e574: 8 total, 8 up, 8 in 2024-09-11T08:31:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:16.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:16.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[29664]: osdmap e575: 8 total, 8 up, 8 in 2024-09-11T08:31:16.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[29664]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[40835]: osdmap e575: 8 total, 8 up, 8 in 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:15 smithi173 ceph-mon[40835]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-mon[32813]: osdmap e575: 8 total, 8 up, 8 in 2024-09-11T08:31:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]: dispatch 2024-09-11T08:31:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:15 smithi175 ceph-mon[32813]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:16.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]': finished 2024-09-11T08:31:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: osdmap e576: 8 total, 8 up, 8 in 2024-09-11T08:31:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: 244.7 scrub starts 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[29664]: 244.7 scrub ok 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]': finished 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: osdmap e576: 8 total, 8 up, 8 in 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: 244.7 scrub starts 2024-09-11T08:31:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:16 smithi173 ceph-mon[40835]: 244.7 scrub ok 2024-09-11T08:31:17.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-116", "mode": "writeback"}]': finished 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: osdmap e576: 8 total, 8 up, 8 in 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "244.7"}]: dispatch 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: 244.7 scrub starts 2024-09-11T08:31:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:16 smithi175 ceph-mon[32813]: 244.7 scrub ok 2024-09-11T08:31:17.962 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:17] "GET /metrics HTTP/1.1" 200 228715 "" "Prometheus/2.43.0" 2024-09-11T08:31:18.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:18.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:17 smithi173 ceph-mon[40835]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T08:31:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:17 smithi173 ceph-mon[29664]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T08:31:18.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:18.370 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:17 smithi175 ceph-mon[32813]: pgmap v899: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T08:31:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:19 smithi173 ceph-mon[29664]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:31:19.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:19 smithi173 ceph-mon[40835]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:31:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:19 smithi175 ceph-mon[32813]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:31:21.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:21.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:21.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:22.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:21 smithi175 ceph-mon[32813]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 967 B/s wr, 2 op/s 2024-09-11T08:31:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:21 smithi173 ceph-mon[29664]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 967 B/s wr, 2 op/s 2024-09-11T08:31:22.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:21 smithi173 ceph-mon[40835]: pgmap v901: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 967 B/s wr, 2 op/s 2024-09-11T08:31:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:23 smithi173 ceph-mon[29664]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 852 B/s wr, 2 op/s 2024-09-11T08:31:23.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:23 smithi173 ceph-mon[40835]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 852 B/s wr, 2 op/s 2024-09-11T08:31:23.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:23 smithi175 ceph-mon[32813]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 852 B/s wr, 2 op/s 2024-09-11T08:31:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:25.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:25 smithi173 ceph-mon[29664]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-09-11T08:31:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:25 smithi173 ceph-mon[40835]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-09-11T08:31:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:25 smithi175 ceph-mon[32813]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-09-11T08:31:26.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:27 smithi173 ceph-mon[29664]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T08:31:27.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:27] "GET /metrics HTTP/1.1" 200 228695 "" "Prometheus/2.43.0" 2024-09-11T08:31:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:27 smithi173 ceph-mon[40835]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T08:31:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:27 smithi175 ceph-mon[32813]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T08:31:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:29 smithi173 ceph-mon[29664]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-11T08:31:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:29 smithi173 ceph-mon[40835]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-11T08:31:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:29 smithi175 ceph-mon[32813]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-11T08:31:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:32 smithi175 ceph-mon[32813]: osdmap e577: 8 total, 8 up, 8 in 2024-09-11T08:31:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:32 smithi175 ceph-mon[32813]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:31:32.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[29664]: osdmap e577: 8 total, 8 up, 8 in 2024-09-11T08:31:32.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[29664]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:31:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[40835]: osdmap e577: 8 total, 8 up, 8 in 2024-09-11T08:31:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:32.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:32 smithi173 ceph-mon[40835]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:31:33.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:33.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:33 smithi175 ceph-mon[32813]: osdmap e578: 8 total, 8 up, 8 in 2024-09-11T08:31:33.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:33.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[29664]: osdmap e578: 8 total, 8 up, 8 in 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[40835]: osdmap e578: 8 total, 8 up, 8 in 2024-09-11T08:31:33.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:33.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]: dispatch 2024-09-11T08:31:34.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:34 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:34.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:34.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:34 smithi175 ceph-mon[32813]: osdmap e579: 8 total, 8 up, 8 in 2024-09-11T08:31:34.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:34 smithi175 ceph-mon[32813]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[29664]: osdmap e579: 8 total, 8 up, 8 in 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[29664]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-116"}]': finished 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[40835]: osdmap e579: 8 total, 8 up, 8 in 2024-09-11T08:31:34.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:34 smithi173 ceph-mon[40835]: pgmap v910: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:31:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:35 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:35 smithi175 ceph-mon[32813]: osdmap e580: 8 total, 8 up, 8 in 2024-09-11T08:31:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:35.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:35.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[29664]: osdmap e580: 8 total, 8 up, 8 in 2024-09-11T08:31:35.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:35.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[40835]: osdmap e580: 8 total, 8 up, 8 in 2024-09-11T08:31:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:35.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:36.454 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:36 smithi175 ceph-mon[32813]: osdmap e581: 8 total, 8 up, 8 in 2024-09-11T08:31:36.454 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.454 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.454 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:36 smithi175 ceph-mon[32813]: pgmap v913: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[29664]: osdmap e581: 8 total, 8 up, 8 in 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[29664]: pgmap v913: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[40835]: osdmap e581: 8 total, 8 up, 8 in 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:36.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:36 smithi173 ceph-mon[40835]: pgmap v913: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:36.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:37.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:37.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:37 smithi175 ceph-mon[32813]: osdmap e582: 8 total, 8 up, 8 in 2024-09-11T08:31:37.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:37.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:37 smithi173 ceph-mon[29664]: osdmap e582: 8 total, 8 up, 8 in 2024-09-11T08:31:37.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:37.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:37 smithi173 ceph-mon[40835]: osdmap e582: 8 total, 8 up, 8 in 2024-09-11T08:31:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:37] "GET /metrics HTTP/1.1" 200 226204 "" "Prometheus/2.43.0" 2024-09-11T08:31:38.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:38.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[40835]: osdmap e583: 8 total, 8 up, 8 in 2024-09-11T08:31:38.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[40835]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-11T08:31:38.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:38.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[29664]: osdmap e583: 8 total, 8 up, 8 in 2024-09-11T08:31:38.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:38 smithi173 ceph-mon[29664]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-11T08:31:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:38 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:38 smithi175 ceph-mon[32813]: osdmap e583: 8 total, 8 up, 8 in 2024-09-11T08:31:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:38.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:38 smithi175 ceph-mon[32813]: pgmap v916: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-09-11T08:31:39.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:39.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[29664]: osdmap e584: 8 total, 8 up, 8 in 2024-09-11T08:31:39.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:39.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:39.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:39.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[40835]: osdmap e584: 8 total, 8 up, 8 in 2024-09-11T08:31:39.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:39.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:39 smithi175 ceph-mon[32813]: osdmap e584: 8 total, 8 up, 8 in 2024-09-11T08:31:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:39.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:40.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:40.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[29664]: osdmap e585: 8 total, 8 up, 8 in 2024-09-11T08:31:40.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[29664]: pgmap v919: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[40835]: osdmap e585: 8 total, 8 up, 8 in 2024-09-11T08:31:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:40 smithi173 ceph-mon[40835]: pgmap v919: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:40 smithi175 ceph-mon[32813]: osdmap e585: 8 total, 8 up, 8 in 2024-09-11T08:31:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]: dispatch 2024-09-11T08:31:40.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:40 smithi175 ceph-mon[32813]: pgmap v919: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]': finished 2024-09-11T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: osdmap e586: 8 total, 8 up, 8 in 2024-09-11T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: osdmap e587: 8 total, 8 up, 8 in 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]': finished 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: osdmap e586: 8 total, 8 up, 8 in 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: osdmap e587: 8 total, 8 up, 8 in 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:41.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-118", "mode": "writeback"}]': finished 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: osdmap e586: 8 total, 8 up, 8 in 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: osdmap e587: 8 total, 8 up, 8 in 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:41.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[29664]: osdmap e588: 8 total, 8 up, 8 in 2024-09-11T08:31:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[29664]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 629 B/s wr, 2 op/s 2024-09-11T08:31:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[40835]: osdmap e588: 8 total, 8 up, 8 in 2024-09-11T08:31:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:42 smithi173 ceph-mon[40835]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 629 B/s wr, 2 op/s 2024-09-11T08:31:42.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:42 smithi175 ceph-mon[32813]: osdmap e588: 8 total, 8 up, 8 in 2024-09-11T08:31:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]: dispatch 2024-09-11T08:31:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:42 smithi175 ceph-mon[32813]: pgmap v923: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 629 B/s wr, 2 op/s 2024-09-11T08:31:43.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:43.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:43.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[29664]: osdmap e589: 8 total, 8 up, 8 in 2024-09-11T08:31:43.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:43.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:43.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:43 smithi173 ceph-mon[40835]: osdmap e589: 8 total, 8 up, 8 in 2024-09-11T08:31:43.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:43 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-118"}]': finished 2024-09-11T08:31:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:43 smithi175 ceph-mon[32813]: osdmap e589: 8 total, 8 up, 8 in 2024-09-11T08:31:44.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:44 smithi173 ceph-mon[29664]: osdmap e590: 8 total, 8 up, 8 in 2024-09-11T08:31:44.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:44 smithi173 ceph-mon[29664]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 632 B/s wr, 2 op/s 2024-09-11T08:31:44.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:44 smithi173 ceph-mon[40835]: osdmap e590: 8 total, 8 up, 8 in 2024-09-11T08:31:44.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:44 smithi173 ceph-mon[40835]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 632 B/s wr, 2 op/s 2024-09-11T08:31:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:44 smithi175 ceph-mon[32813]: osdmap e590: 8 total, 8 up, 8 in 2024-09-11T08:31:44.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:44 smithi175 ceph-mon[32813]: pgmap v926: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 632 B/s wr, 2 op/s 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: osdmap e591: 8 total, 8 up, 8 in 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: osdmap e592: 8 total, 8 up, 8 in 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:45.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:45.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: osdmap e591: 8 total, 8 up, 8 in 2024-09-11T08:31:45.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: osdmap e592: 8 total, 8 up, 8 in 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: osdmap e591: 8 total, 8 up, 8 in 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: osdmap e592: 8 total, 8 up, 8 in 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:45.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:46.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-mon[32813]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-mon[32813]: osdmap e593: 8 total, 8 up, 8 in 2024-09-11T08:31:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:46.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[29664]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[29664]: osdmap e593: 8 total, 8 up, 8 in 2024-09-11T08:31:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:46.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[40835]: pgmap v929: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[40835]: osdmap e593: 8 total, 8 up, 8 in 2024-09-11T08:31:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:46.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:47] "GET /metrics HTTP/1.1" 200 226204 "" "Prometheus/2.43.0" 2024-09-11T08:31:48.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:48.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:48.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: osdmap e594: 8 total, 8 up, 8 in 2024-09-11T08:31:48.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[29664]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: osdmap e594: 8 total, 8 up, 8 in 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:48 smithi173 ceph-mon[40835]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: osdmap e594: 8 total, 8 up, 8 in 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]: dispatch 2024-09-11T08:31:48.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:48 smithi175 ceph-mon[32813]: pgmap v932: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:49.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:49.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]': finished 2024-09-11T08:31:49.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[29664]: osdmap e595: 8 total, 8 up, 8 in 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]': finished 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[40835]: osdmap e595: 8 total, 8 up, 8 in 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:49.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:49 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-120", "mode": "writeback"}]': finished 2024-09-11T08:31:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:49 smithi175 ceph-mon[32813]: osdmap e595: 8 total, 8 up, 8 in 2024-09-11T08:31:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:49.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: osdmap e596: 8 total, 8 up, 8 in 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:50.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: osdmap e596: 8 total, 8 up, 8 in 2024-09-11T08:31:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: osdmap e596: 8 total, 8 up, 8 in 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]: dispatch 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: pgmap v935: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:50.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:31:50.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:31:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:51 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:51.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:51 smithi175 ceph-mon[32813]: osdmap e597: 8 total, 8 up, 8 in 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[29664]: osdmap e597: 8 total, 8 up, 8 in 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-120"}]': finished 2024-09-11T08:31:51.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:51 smithi173 ceph-mon[40835]: osdmap e597: 8 total, 8 up, 8 in 2024-09-11T08:31:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:52 smithi175 ceph-mon[32813]: osdmap e598: 8 total, 8 up, 8 in 2024-09-11T08:31:52.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:52 smithi175 ceph-mon[32813]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:52 smithi173 ceph-mon[29664]: osdmap e598: 8 total, 8 up, 8 in 2024-09-11T08:31:52.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:52 smithi173 ceph-mon[29664]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:52.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:52 smithi173 ceph-mon[40835]: osdmap e598: 8 total, 8 up, 8 in 2024-09-11T08:31:52.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:52 smithi173 ceph-mon[40835]: pgmap v938: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:53.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:53 smithi175 ceph-mon[32813]: osdmap e599: 8 total, 8 up, 8 in 2024-09-11T08:31:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:53.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[29664]: osdmap e599: 8 total, 8 up, 8 in 2024-09-11T08:31:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:53.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[40835]: osdmap e599: 8 total, 8 up, 8 in 2024-09-11T08:31:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:53.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:31:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:54 smithi175 ceph-mon[32813]: osdmap e600: 8 total, 8 up, 8 in 2024-09-11T08:31:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:54 smithi175 ceph-mon[32813]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[29664]: osdmap e600: 8 total, 8 up, 8 in 2024-09-11T08:31:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[29664]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:31:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[40835]: osdmap e600: 8 total, 8 up, 8 in 2024-09-11T08:31:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:31:54.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:54 smithi173 ceph-mon[40835]: pgmap v941: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:55.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:55.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:55 smithi175 ceph-mon[32813]: osdmap e601: 8 total, 8 up, 8 in 2024-09-11T08:31:55.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:55.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:55.345 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:31:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:31:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[29664]: osdmap e601: 8 total, 8 up, 8 in 2024-09-11T08:31:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:55.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:31:55.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[40835]: osdmap e601: 8 total, 8 up, 8 in 2024-09-11T08:31:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:55.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:56.593 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:31:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-mon[32813]: osdmap e602: 8 total, 8 up, 8 in 2024-09-11T08:31:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:56 smithi175 ceph-mon[32813]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[40835]: osdmap e602: 8 total, 8 up, 8 in 2024-09-11T08:31:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[40835]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[29664]: osdmap e602: 8 total, 8 up, 8 in 2024-09-11T08:31:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]: dispatch 2024-09-11T08:31:56.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:56 smithi173 ceph-mon[29664]: pgmap v944: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:31:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]': finished 2024-09-11T08:31:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[29664]: osdmap e603: 8 total, 8 up, 8 in 2024-09-11T08:31:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]': finished 2024-09-11T08:31:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[40835]: osdmap e603: 8 total, 8 up, 8 in 2024-09-11T08:31:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:57 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:31:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-122", "mode": "writeback"}]': finished 2024-09-11T08:31:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:57 smithi175 ceph-mon[32813]: osdmap e603: 8 total, 8 up, 8 in 2024-09-11T08:31:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:31:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:31:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:31:57] "GET /metrics HTTP/1.1" 200 228705 "" "Prometheus/2.43.0" 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: osdmap e604: 8 total, 8 up, 8 in 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:58 smithi175 ceph-mon[32813]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: osdmap e604: 8 total, 8 up, 8 in 2024-09-11T08:31:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[40835]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: osdmap e604: 8 total, 8 up, 8 in 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]: dispatch 2024-09-11T08:31:58.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:58 smithi173 ceph-mon[29664]: pgmap v947: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:31:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:59 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:31:59 smithi175 ceph-mon[32813]: osdmap e605: 8 total, 8 up, 8 in 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[29664]: osdmap e605: 8 total, 8 up, 8 in 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-122"}]': finished 2024-09-11T08:31:59.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:31:59 smithi173 ceph-mon[40835]: osdmap e605: 8 total, 8 up, 8 in 2024-09-11T08:32:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:00 smithi175 ceph-mon[32813]: osdmap e606: 8 total, 8 up, 8 in 2024-09-11T08:32:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:00 smithi175 ceph-mon[32813]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:00 smithi173 ceph-mon[29664]: osdmap e606: 8 total, 8 up, 8 in 2024-09-11T08:32:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:00 smithi173 ceph-mon[29664]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:00.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:00 smithi173 ceph-mon[40835]: osdmap e606: 8 total, 8 up, 8 in 2024-09-11T08:32:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:00 smithi173 ceph-mon[40835]: pgmap v950: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:01.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:01 smithi175 ceph-mon[32813]: osdmap e607: 8 total, 8 up, 8 in 2024-09-11T08:32:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:01.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[29664]: osdmap e607: 8 total, 8 up, 8 in 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[40835]: osdmap e607: 8 total, 8 up, 8 in 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:01.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:02 smithi175 ceph-mon[32813]: osdmap e608: 8 total, 8 up, 8 in 2024-09-11T08:32:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:02 smithi175 ceph-mon[32813]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:02 smithi175 ceph-mon[32813]: osdmap e609: 8 total, 8 up, 8 in 2024-09-11T08:32:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[29664]: osdmap e608: 8 total, 8 up, 8 in 2024-09-11T08:32:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[29664]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:02.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[29664]: osdmap e609: 8 total, 8 up, 8 in 2024-09-11T08:32:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[40835]: osdmap e608: 8 total, 8 up, 8 in 2024-09-11T08:32:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[40835]: pgmap v953: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:02.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:02 smithi173 ceph-mon[40835]: osdmap e609: 8 total, 8 up, 8 in 2024-09-11T08:32:03.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[29664]: osdmap e610: 8 total, 8 up, 8 in 2024-09-11T08:32:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[29664]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[40835]: osdmap e610: 8 total, 8 up, 8 in 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:04 smithi173 ceph-mon[40835]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:04 smithi175 ceph-mon[32813]: osdmap e610: 8 total, 8 up, 8 in 2024-09-11T08:32:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:04.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:04 smithi175 ceph-mon[32813]: pgmap v956: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: osdmap e611: 8 total, 8 up, 8 in 2024-09-11T08:32:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: osdmap e611: 8 total, 8 up, 8 in 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: osdmap e611: 8 total, 8 up, 8 in 2024-09-11T08:32:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]: dispatch 2024-09-11T08:32:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:05.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]': finished 2024-09-11T08:32:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[29664]: osdmap e612: 8 total, 8 up, 8 in 2024-09-11T08:32:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[29664]: pgmap v959: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]': finished 2024-09-11T08:32:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[40835]: osdmap e612: 8 total, 8 up, 8 in 2024-09-11T08:32:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:06 smithi173 ceph-mon[40835]: pgmap v959: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:06.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:06 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-124", "mode": "writeback"}]': finished 2024-09-11T08:32:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:06 smithi175 ceph-mon[32813]: osdmap e612: 8 total, 8 up, 8 in 2024-09-11T08:32:06.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:06 smithi175 ceph-mon[32813]: pgmap v959: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:07.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[29664]: osdmap e613: 8 total, 8 up, 8 in 2024-09-11T08:32:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:07.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:07.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:07] "GET /metrics HTTP/1.1" 200 228716 "" "Prometheus/2.43.0" 2024-09-11T08:32:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[40835]: osdmap e613: 8 total, 8 up, 8 in 2024-09-11T08:32:07.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:07.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:07.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:07 smithi175 ceph-mon[32813]: osdmap e613: 8 total, 8 up, 8 in 2024-09-11T08:32:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:08.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: pgmap v961: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:08.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:08.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: osdmap e614: 8 total, 8 up, 8 in 2024-09-11T08:32:08.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:08.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: pgmap v961: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: osdmap e614: 8 total, 8 up, 8 in 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:08.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: pgmap v961: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: osdmap e614: 8 total, 8 up, 8 in 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:08.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]: dispatch 2024-09-11T08:32:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[29664]: osdmap e615: 8 total, 8 up, 8 in 2024-09-11T08:32:09.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:09 smithi173 ceph-mon[40835]: osdmap e615: 8 total, 8 up, 8 in 2024-09-11T08:32:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:09 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-124"}]': finished 2024-09-11T08:32:09.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:09 smithi175 ceph-mon[32813]: osdmap e615: 8 total, 8 up, 8 in 2024-09-11T08:32:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[29664]: pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[29664]: osdmap e616: 8 total, 8 up, 8 in 2024-09-11T08:32:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:32:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[40835]: pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[40835]: osdmap e616: 8 total, 8 up, 8 in 2024-09-11T08:32:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:10 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:32:10.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:10 smithi175 ceph-mon[32813]: pgmap v964: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:32:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:10 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:10 smithi175 ceph-mon[32813]: osdmap e616: 8 total, 8 up, 8 in 2024-09-11T08:32:10.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:10 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:32:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: osdmap e617: 8 total, 8 up, 8 in 2024-09-11T08:32:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: osdmap e617: 8 total, 8 up, 8 in 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:32:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: osdmap e617: 8 total, 8 up, 8 in 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:32:11.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[29664]: pgmap v967: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[29664]: osdmap e618: 8 total, 8 up, 8 in 2024-09-11T08:32:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[40835]: pgmap v967: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[40835]: osdmap e618: 8 total, 8 up, 8 in 2024-09-11T08:32:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:12 smithi175 ceph-mon[32813]: pgmap v967: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:12 smithi175 ceph-mon[32813]: osdmap e618: 8 total, 8 up, 8 in 2024-09-11T08:32:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[29664]: osdmap e619: 8 total, 8 up, 8 in 2024-09-11T08:32:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[29664]: pgmap v970: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[40835]: osdmap e619: 8 total, 8 up, 8 in 2024-09-11T08:32:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:13 smithi173 ceph-mon[40835]: pgmap v970: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:13.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:13 smithi175 ceph-mon[32813]: osdmap e619: 8 total, 8 up, 8 in 2024-09-11T08:32:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:13 smithi175 ceph-mon[32813]: pgmap v970: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[40835]: osdmap e620: 8 total, 8 up, 8 in 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[29664]: osdmap e620: 8 total, 8 up, 8 in 2024-09-11T08:32:14.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:14.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:14.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:14.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:14 smithi175 ceph-mon[32813]: osdmap e620: 8 total, 8 up, 8 in 2024-09-11T08:32:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:14.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]: dispatch 2024-09-11T08:32:15.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]': finished 2024-09-11T08:32:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: osdmap e621: 8 total, 8 up, 8 in 2024-09-11T08:32:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: osdmap e622: 8 total, 8 up, 8 in 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[40835]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]': finished 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: osdmap e621: 8 total, 8 up, 8 in 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:15.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:15.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: osdmap e622: 8 total, 8 up, 8 in 2024-09-11T08:32:15.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.718 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:15 smithi173 ceph-mon[29664]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-126", "mode": "writeback"}]': finished 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: osdmap e621: 8 total, 8 up, 8 in 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:15.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: osdmap e622: 8 total, 8 up, 8 in 2024-09-11T08:32:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]: dispatch 2024-09-11T08:32:15.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:15 smithi175 ceph-mon[32813]: pgmap v974: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:16.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[29664]: osdmap e623: 8 total, 8 up, 8 in 2024-09-11T08:32:16.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:16.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:16.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:16 smithi173 ceph-mon[40835]: osdmap e623: 8 total, 8 up, 8 in 2024-09-11T08:32:16.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:16.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:16 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:16.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-126"}]': finished 2024-09-11T08:32:16.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:16 smithi175 ceph-mon[32813]: osdmap e623: 8 total, 8 up, 8 in 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9082 ms) 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6043 ms) 2024-09-11T08:32:17.210 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5045 ms) 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25649 ms) 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14005 ms) 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12091 ms) 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 00000010 69 73 |is| 2024-09-11T08:32:17.211 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 00000012 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12093 ms) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: require_osd_release = quincy 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6061 ms) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (555158 ms total) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1018 ms) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11045 ms) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18113 ms) 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-09-11T08:32:17.212 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (1 ms) 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30177 ms total) 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7036 ms) 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8012 ms) 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: waiting for scrub... 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: done waiting 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24154 ms) 2024-09-11T08:32:17.213 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9115 ms) 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8032 ms) 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8069 ms) 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10100 ms) 2024-09-11T08:32:17.214 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T08:32:17.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:17] "GET /metrics HTTP/1.1" 200 228716 "" "Prometheus/2.43.0" 2024-09-11T08:32:18.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:18.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[29664]: osdmap e624: 8 total, 8 up, 8 in 2024-09-11T08:32:18.466 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[29664]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 259 B/s wr, 1 op/s 2024-09-11T08:32:18.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:18.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[40835]: osdmap e624: 8 total, 8 up, 8 in 2024-09-11T08:32:18.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:18 smithi173 ceph-mon[40835]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 259 B/s wr, 1 op/s 2024-09-11T08:32:18.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:18 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:18.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:18 smithi175 ceph-mon[32813]: osdmap e624: 8 total, 8 up, 8 in 2024-09-11T08:32:18.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:18 smithi175 ceph-mon[32813]: pgmap v977: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 259 B/s wr, 1 op/s 2024-09-11T08:32:19.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:19 smithi175 ceph-mon[32813]: osdmap e625: 8 total, 8 up, 8 in 2024-09-11T08:32:19.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:19.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[29664]: osdmap e625: 8 total, 8 up, 8 in 2024-09-11T08:32:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[40835]: osdmap e625: 8 total, 8 up, 8 in 2024-09-11T08:32:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:20.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: osdmap e626: 8 total, 8 up, 8 in 2024-09-11T08:32:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:20.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: osdmap e626: 8 total, 8 up, 8 in 2024-09-11T08:32:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: osdmap e626: 8 total, 8 up, 8 in 2024-09-11T08:32:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:20.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: pgmap v980: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:20.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:21.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:21.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:21 smithi175 ceph-mon[32813]: osdmap e627: 8 total, 8 up, 8 in 2024-09-11T08:32:21.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:21.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[29664]: osdmap e627: 8 total, 8 up, 8 in 2024-09-11T08:32:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[40835]: osdmap e627: 8 total, 8 up, 8 in 2024-09-11T08:32:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:22 smithi175 ceph-mon[32813]: osdmap e628: 8 total, 8 up, 8 in 2024-09-11T08:32:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:22 smithi175 ceph-mon[32813]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[29664]: osdmap e628: 8 total, 8 up, 8 in 2024-09-11T08:32:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[29664]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[40835]: osdmap e628: 8 total, 8 up, 8 in 2024-09-11T08:32:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]: dispatch 2024-09-11T08:32:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:22 smithi173 ceph-mon[40835]: pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:23 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:23 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]': finished 2024-09-11T08:32:23.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:23 smithi175 ceph-mon[32813]: osdmap e629: 8 total, 8 up, 8 in 2024-09-11T08:32:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]': finished 2024-09-11T08:32:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[29664]: osdmap e629: 8 total, 8 up, 8 in 2024-09-11T08:32:23.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:23.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-128", "mode": "writeback"}]': finished 2024-09-11T08:32:23.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:23 smithi173 ceph-mon[40835]: osdmap e629: 8 total, 8 up, 8 in 2024-09-11T08:32:24.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:24 smithi175 ceph-mon[32813]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:24 smithi173 ceph-mon[29664]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:24 smithi173 ceph-mon[40835]: pgmap v985: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:25 smithi173 ceph-mon[29664]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:32:25.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:25 smithi173 ceph-mon[40835]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:32:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:25 smithi175 ceph-mon[32813]: pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:32:26.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:27.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:27] "GET /metrics HTTP/1.1" 200 228736 "" "Prometheus/2.43.0" 2024-09-11T08:32:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:27.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:27 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:27 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:27.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:27 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: pgmap v987: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 286 B/s wr, 1 op/s 2024-09-11T08:32:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: osdmap e630: 8 total, 8 up, 8 in 2024-09-11T08:32:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: pgmap v987: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 286 B/s wr, 1 op/s 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: osdmap e630: 8 total, 8 up, 8 in 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:28.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: pgmap v987: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 286 B/s wr, 1 op/s 2024-09-11T08:32:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: osdmap e630: 8 total, 8 up, 8 in 2024-09-11T08:32:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]: dispatch 2024-09-11T08:32:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[29664]: osdmap e631: 8 total, 8 up, 8 in 2024-09-11T08:32:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:29.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:29 smithi173 ceph-mon[40835]: osdmap e631: 8 total, 8 up, 8 in 2024-09-11T08:32:29.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:29 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-128"}]': finished 2024-09-11T08:32:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:29 smithi175 ceph-mon[32813]: osdmap e631: 8 total, 8 up, 8 in 2024-09-11T08:32:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[29664]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-11T08:32:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:30.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[29664]: osdmap e632: 8 total, 8 up, 8 in 2024-09-11T08:32:30.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[40835]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-11T08:32:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:30.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:30 smithi173 ceph-mon[40835]: osdmap e632: 8 total, 8 up, 8 in 2024-09-11T08:32:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:30 smithi175 ceph-mon[32813]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 862 B/s rd, 287 B/s wr, 1 op/s 2024-09-11T08:32:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:30 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:30 smithi175 ceph-mon[32813]: osdmap e632: 8 total, 8 up, 8 in 2024-09-11T08:32:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[29664]: osdmap e633: 8 total, 8 up, 8 in 2024-09-11T08:32:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:31.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[40835]: osdmap e633: 8 total, 8 up, 8 in 2024-09-11T08:32:31.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:31 smithi175 ceph-mon[32813]: osdmap e633: 8 total, 8 up, 8 in 2024-09-11T08:32:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[40835]: pgmap v993: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[40835]: osdmap e634: 8 total, 8 up, 8 in 2024-09-11T08:32:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:32.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[29664]: pgmap v993: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[29664]: osdmap e634: 8 total, 8 up, 8 in 2024-09-11T08:32:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:32.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:32.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:32 smithi175 ceph-mon[32813]: pgmap v993: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:32 smithi175 ceph-mon[32813]: osdmap e634: 8 total, 8 up, 8 in 2024-09-11T08:32:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:32.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[29664]: osdmap e635: 8 total, 8 up, 8 in 2024-09-11T08:32:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[29664]: pgmap v996: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[40835]: osdmap e635: 8 total, 8 up, 8 in 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:33 smithi173 ceph-mon[40835]: pgmap v996: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:33 smithi175 ceph-mon[32813]: osdmap e635: 8 total, 8 up, 8 in 2024-09-11T08:32:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:33 smithi175 ceph-mon[32813]: pgmap v996: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[29664]: osdmap e636: 8 total, 8 up, 8 in 2024-09-11T08:32:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:34.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[40835]: osdmap e636: 8 total, 8 up, 8 in 2024-09-11T08:32:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:34.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:34 smithi175 ceph-mon[32813]: osdmap e636: 8 total, 8 up, 8 in 2024-09-11T08:32:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]: dispatch 2024-09-11T08:32:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]': finished 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: osdmap e637: 8 total, 8 up, 8 in 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[29664]: pgmap v999: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]': finished 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: osdmap e637: 8 total, 8 up, 8 in 2024-09-11T08:32:35.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:35.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:35 smithi173 ceph-mon[40835]: pgmap v999: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-130", "mode": "writeback"}]': finished 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: osdmap e637: 8 total, 8 up, 8 in 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:35.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:35 smithi175 ceph-mon[32813]: pgmap v999: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[29664]: osdmap e638: 8 total, 8 up, 8 in 2024-09-11T08:32:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:36.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[40835]: osdmap e638: 8 total, 8 up, 8 in 2024-09-11T08:32:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:36.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:36 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:36.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:36 smithi175 ceph-mon[32813]: osdmap e638: 8 total, 8 up, 8 in 2024-09-11T08:32:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:36 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:36 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]: dispatch 2024-09-11T08:32:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[29664]: osdmap e639: 8 total, 8 up, 8 in 2024-09-11T08:32:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[29664]: pgmap v1002: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:37] "GET /metrics HTTP/1.1" 200 228716 "" "Prometheus/2.43.0" 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[40835]: osdmap e639: 8 total, 8 up, 8 in 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:37.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:37 smithi173 ceph-mon[40835]: pgmap v1002: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:32:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:37 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-130"}]': finished 2024-09-11T08:32:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:37 smithi175 ceph-mon[32813]: osdmap e639: 8 total, 8 up, 8 in 2024-09-11T08:32:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:37 smithi175 ceph-mon[32813]: pgmap v1002: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-11T08:32:38.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:38 smithi173 ceph-mon[29664]: osdmap e640: 8 total, 8 up, 8 in 2024-09-11T08:32:38.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:38 smithi173 ceph-mon[40835]: osdmap e640: 8 total, 8 up, 8 in 2024-09-11T08:32:38.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:38 smithi175 ceph-mon[32813]: osdmap e640: 8 total, 8 up, 8 in 2024-09-11T08:32:39.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[29664]: osdmap e641: 8 total, 8 up, 8 in 2024-09-11T08:32:39.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[29664]: pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[40835]: osdmap e641: 8 total, 8 up, 8 in 2024-09-11T08:32:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:39 smithi173 ceph-mon[40835]: pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:39 smithi175 ceph-mon[32813]: osdmap e641: 8 total, 8 up, 8 in 2024-09-11T08:32:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:39 smithi175 ceph-mon[32813]: pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-11T08:32:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:40 smithi175 ceph-mon[32813]: osdmap e642: 8 total, 8 up, 8 in 2024-09-11T08:32:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:40 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[29664]: osdmap e642: 8 total, 8 up, 8 in 2024-09-11T08:32:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[40835]: osdmap e642: 8 total, 8 up, 8 in 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:40 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:41 smithi175 ceph-mon[32813]: osdmap e643: 8 total, 8 up, 8 in 2024-09-11T08:32:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:41 smithi175 ceph-mon[32813]: pgmap v1008: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[29664]: osdmap e643: 8 total, 8 up, 8 in 2024-09-11T08:32:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[29664]: pgmap v1008: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[40835]: osdmap e643: 8 total, 8 up, 8 in 2024-09-11T08:32:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:41 smithi173 ceph-mon[40835]: pgmap v1008: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:32:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:42 smithi175 ceph-mon[32813]: osdmap e644: 8 total, 8 up, 8 in 2024-09-11T08:32:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[29664]: osdmap e644: 8 total, 8 up, 8 in 2024-09-11T08:32:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[40835]: osdmap e644: 8 total, 8 up, 8 in 2024-09-11T08:32:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]: dispatch 2024-09-11T08:32:43.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:43 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]': finished 2024-09-11T08:32:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:43 smithi175 ceph-mon[32813]: osdmap e645: 8 total, 8 up, 8 in 2024-09-11T08:32:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:43 smithi175 ceph-mon[32813]: pgmap v1011: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]': finished 2024-09-11T08:32:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[29664]: osdmap e645: 8 total, 8 up, 8 in 2024-09-11T08:32:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[29664]: pgmap v1011: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:43.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-132", "mode": "writeback"}]': finished 2024-09-11T08:32:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[40835]: osdmap e645: 8 total, 8 up, 8 in 2024-09-11T08:32:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:43 smithi173 ceph-mon[40835]: pgmap v1011: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:32:44.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:44 smithi175 ceph-mon[32813]: osdmap e646: 8 total, 8 up, 8 in 2024-09-11T08:32:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:44 smithi173 ceph-mon[29664]: osdmap e646: 8 total, 8 up, 8 in 2024-09-11T08:32:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:44 smithi173 ceph-mon[40835]: osdmap e646: 8 total, 8 up, 8 in 2024-09-11T08:32:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:45.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-mon[32813]: osdmap e647: 8 total, 8 up, 8 in 2024-09-11T08:32:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:45 smithi175 ceph-mon[32813]: pgmap v1014: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[29664]: osdmap e647: 8 total, 8 up, 8 in 2024-09-11T08:32:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[29664]: pgmap v1014: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[40835]: osdmap e647: 8 total, 8 up, 8 in 2024-09-11T08:32:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:45 smithi173 ceph-mon[40835]: pgmap v1014: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:46.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:46 smithi175 ceph-mon[32813]: osdmap e648: 8 total, 8 up, 8 in 2024-09-11T08:32:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:46.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:46.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[29664]: osdmap e648: 8 total, 8 up, 8 in 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[40835]: osdmap e648: 8 total, 8 up, 8 in 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:47.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:47 smithi175 ceph-mon[32813]: osdmap e649: 8 total, 8 up, 8 in 2024-09-11T08:32:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:47 smithi175 ceph-mon[32813]: pgmap v1017: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:47] "GET /metrics HTTP/1.1" 200 228716 "" "Prometheus/2.43.0" 2024-09-11T08:32:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[29664]: osdmap e649: 8 total, 8 up, 8 in 2024-09-11T08:32:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[29664]: pgmap v1017: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[40835]: osdmap e649: 8 total, 8 up, 8 in 2024-09-11T08:32:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:47 smithi173 ceph-mon[40835]: pgmap v1017: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:48 smithi175 ceph-mon[32813]: osdmap e650: 8 total, 8 up, 8 in 2024-09-11T08:32:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[29664]: osdmap e650: 8 total, 8 up, 8 in 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[40835]: osdmap e650: 8 total, 8 up, 8 in 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:49 smithi175 ceph-mon[32813]: osdmap e651: 8 total, 8 up, 8 in 2024-09-11T08:32:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:49 smithi175 ceph-mon[32813]: pgmap v1020: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[29664]: osdmap e651: 8 total, 8 up, 8 in 2024-09-11T08:32:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[29664]: pgmap v1020: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[40835]: osdmap e651: 8 total, 8 up, 8 in 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]: dispatch 2024-09-11T08:32:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:49 smithi173 ceph-mon[40835]: pgmap v1020: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-11T08:32:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:50 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:50 smithi175 ceph-mon[32813]: osdmap e652: 8 total, 8 up, 8 in 2024-09-11T08:32:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:50.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[29664]: osdmap e652: 8 total, 8 up, 8 in 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-132"}]': finished 2024-09-11T08:32:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[40835]: osdmap e652: 8 total, 8 up, 8 in 2024-09-11T08:32:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:32:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:32:51.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:51 smithi175 ceph-mon[32813]: osdmap e653: 8 total, 8 up, 8 in 2024-09-11T08:32:51.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:51 smithi175 ceph-mon[32813]: pgmap v1023: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:51 smithi173 ceph-mon[29664]: osdmap e653: 8 total, 8 up, 8 in 2024-09-11T08:32:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:51 smithi173 ceph-mon[29664]: pgmap v1023: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:51 smithi173 ceph-mon[40835]: osdmap e653: 8 total, 8 up, 8 in 2024-09-11T08:32:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:51 smithi173 ceph-mon[40835]: pgmap v1023: 172 pgs: 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:52.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:52 smithi175 ceph-mon[32813]: osdmap e654: 8 total, 8 up, 8 in 2024-09-11T08:32:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:52.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[29664]: osdmap e654: 8 total, 8 up, 8 in 2024-09-11T08:32:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[40835]: osdmap e654: 8 total, 8 up, 8 in 2024-09-11T08:32:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:32:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:53 smithi175 ceph-mon[32813]: osdmap e655: 8 total, 8 up, 8 in 2024-09-11T08:32:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:53 smithi175 ceph-mon[32813]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[29664]: osdmap e655: 8 total, 8 up, 8 in 2024-09-11T08:32:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[29664]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:32:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[40835]: osdmap e655: 8 total, 8 up, 8 in 2024-09-11T08:32:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:32:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:53 smithi173 ceph-mon[40835]: pgmap v1026: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-11T08:32:54.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:54 smithi175 ceph-mon[32813]: osdmap e656: 8 total, 8 up, 8 in 2024-09-11T08:32:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:54.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[29664]: osdmap e656: 8 total, 8 up, 8 in 2024-09-11T08:32:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:32:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[40835]: osdmap e656: 8 total, 8 up, 8 in 2024-09-11T08:32:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:55.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:32:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:55.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: osdmap e657: 8 total, 8 up, 8 in 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]': finished 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: osdmap e658: 8 total, 8 up, 8 in 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:55 smithi175 ceph-mon[32813]: pgmap v1030: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: osdmap e657: 8 total, 8 up, 8 in 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]': finished 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: osdmap e658: 8 total, 8 up, 8 in 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[29664]: pgmap v1030: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: osdmap e657: 8 total, 8 up, 8 in 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]: dispatch 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-134", "mode": "writeback"}]': finished 2024-09-11T08:32:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: osdmap e658: 8 total, 8 up, 8 in 2024-09-11T08:32:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:32:55.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:55 smithi173 ceph-mon[40835]: pgmap v1030: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:32:56.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:32:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:32:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[29664]: osdmap e659: 8 total, 8 up, 8 in 2024-09-11T08:32:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[40835]: osdmap e659: 8 total, 8 up, 8 in 2024-09-11T08:32:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:32:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:57 smithi175 ceph-mon[32813]: osdmap e659: 8 total, 8 up, 8 in 2024-09-11T08:32:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:57 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:57 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]: dispatch 2024-09-11T08:32:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:32:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:32:57] "GET /metrics HTTP/1.1" 200 228740 "" "Prometheus/2.43.0" 2024-09-11T08:32:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:58 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:58 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:58 smithi175 ceph-mon[32813]: osdmap e660: 8 total, 8 up, 8 in 2024-09-11T08:32:58.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:58 smithi175 ceph-mon[32813]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[29664]: osdmap e660: 8 total, 8 up, 8 in 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[29664]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-11T08:32:58.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:32:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:32:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-134"}]': finished 2024-09-11T08:32:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[40835]: osdmap e660: 8 total, 8 up, 8 in 2024-09-11T08:32:58.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:58 smithi173 ceph-mon[40835]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-11T08:32:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:59 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:59.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:32:59 smithi175 ceph-mon[32813]: osdmap e661: 8 total, 8 up, 8 in 2024-09-11T08:32:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:59 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:59.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:32:59 smithi173 ceph-mon[29664]: osdmap e661: 8 total, 8 up, 8 in 2024-09-11T08:32:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:59 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:32:59.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:32:59 smithi173 ceph-mon[40835]: osdmap e661: 8 total, 8 up, 8 in 2024-09-11T08:33:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:00 smithi175 ceph-mon[32813]: osdmap e662: 8 total, 8 up, 8 in 2024-09-11T08:33:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:00 smithi175 ceph-mon[32813]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:33:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[29664]: osdmap e662: 8 total, 8 up, 8 in 2024-09-11T08:33:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[29664]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:33:00.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[40835]: osdmap e662: 8 total, 8 up, 8 in 2024-09-11T08:33:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:00.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:00 smithi173 ceph-mon[40835]: pgmap v1036: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-11T08:33:01.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:01.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:01 smithi175 ceph-mon[32813]: osdmap e663: 8 total, 8 up, 8 in 2024-09-11T08:33:01.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:01 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:01.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:01 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[29664]: osdmap e663: 8 total, 8 up, 8 in 2024-09-11T08:33:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:01.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[40835]: osdmap e663: 8 total, 8 up, 8 in 2024-09-11T08:33:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:01.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:01 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:02 smithi175 ceph-mon[32813]: osdmap e664: 8 total, 8 up, 8 in 2024-09-11T08:33:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:02 smithi175 ceph-mon[32813]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[29664]: osdmap e664: 8 total, 8 up, 8 in 2024-09-11T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[29664]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[40835]: osdmap e664: 8 total, 8 up, 8 in 2024-09-11T08:33:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:02.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:02 smithi173 ceph-mon[40835]: pgmap v1039: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:03 smithi175 ceph-mon[32813]: osdmap e665: 8 total, 8 up, 8 in 2024-09-11T08:33:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[29664]: osdmap e665: 8 total, 8 up, 8 in 2024-09-11T08:33:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[40835]: osdmap e665: 8 total, 8 up, 8 in 2024-09-11T08:33:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:03.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]: dispatch 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]': finished 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: osdmap e666: 8 total, 8 up, 8 in 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:04 smithi175 ceph-mon[32813]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]': finished 2024-09-11T08:33:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: osdmap e666: 8 total, 8 up, 8 in 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[29664]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-136", "mode": "writeback"}]': finished 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: osdmap e666: 8 total, 8 up, 8 in 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:04 smithi173 ceph-mon[40835]: pgmap v1042: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: osdmap e667: 8 total, 8 up, 8 in 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:05 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: osdmap e667: 8 total, 8 up, 8 in 2024-09-11T08:33:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: osdmap e667: 8 total, 8 up, 8 in 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]: dispatch 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:05 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:06.534 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:06 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:06.535 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:06.535 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:06 smithi175 ceph-mon[32813]: osdmap e668: 8 total, 8 up, 8 in 2024-09-11T08:33:06.535 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:06 smithi175 ceph-mon[32813]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[29664]: osdmap e668: 8 total, 8 up, 8 in 2024-09-11T08:33:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[29664]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-136"}]': finished 2024-09-11T08:33:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[40835]: osdmap e668: 8 total, 8 up, 8 in 2024-09-11T08:33:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:06 smithi173 ceph-mon[40835]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:06.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:07.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:07 smithi173 ceph-mon[29664]: osdmap e669: 8 total, 8 up, 8 in 2024-09-11T08:33:07.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:07 smithi173 ceph-mon[40835]: osdmap e669: 8 total, 8 up, 8 in 2024-09-11T08:33:07.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:07 smithi175 ceph-mon[32813]: osdmap e669: 8 total, 8 up, 8 in 2024-09-11T08:33:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:07] "GET /metrics HTTP/1.1" 200 228737 "" "Prometheus/2.43.0" 2024-09-11T08:33:08.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:08 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:08 smithi175 ceph-mon[32813]: osdmap e670: 8 total, 8 up, 8 in 2024-09-11T08:33:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:08 smithi175 ceph-mon[32813]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-11T08:33:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[29664]: osdmap e670: 8 total, 8 up, 8 in 2024-09-11T08:33:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[29664]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-11T08:33:08.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:08.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[40835]: osdmap e670: 8 total, 8 up, 8 in 2024-09-11T08:33:08.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:08.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:08 smithi173 ceph-mon[40835]: pgmap v1048: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 977 KiB/s wr, 1 op/s 2024-09-11T08:33:09.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:09.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:09 smithi175 ceph-mon[32813]: osdmap e671: 8 total, 8 up, 8 in 2024-09-11T08:33:09.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:09.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[29664]: osdmap e671: 8 total, 8 up, 8 in 2024-09-11T08:33:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:09.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[40835]: osdmap e671: 8 total, 8 up, 8 in 2024-09-11T08:33:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:09.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: osdmap e672: 8 total, 8 up, 8 in 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:33:10.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:10 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: osdmap e672: 8 total, 8 up, 8 in 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:33:10.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: osdmap e672: 8 total, 8 up, 8 in 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: pgmap v1051: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-09-11T08:33:10.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:10 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: osdmap e673: 8 total, 8 up, 8 in 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:33:11.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: osdmap e673: 8 total, 8 up, 8 in 2024-09-11T08:33:11.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: osdmap e673: 8 total, 8 up, 8 in 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:33:11.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:33:11.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:12 smithi175 ceph-mon[32813]: osdmap e674: 8 total, 8 up, 8 in 2024-09-11T08:33:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:12 smithi175 ceph-mon[32813]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[29664]: osdmap e674: 8 total, 8 up, 8 in 2024-09-11T08:33:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[29664]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[40835]: osdmap e674: 8 total, 8 up, 8 in 2024-09-11T08:33:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-09-11T08:33:12.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:12 smithi173 ceph-mon[40835]: pgmap v1054: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:13.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:33:13.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:13 smithi175 ceph-mon[32813]: osdmap e675: 8 total, 8 up, 8 in 2024-09-11T08:33:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:33:13.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:13 smithi173 ceph-mon[29664]: osdmap e675: 8 total, 8 up, 8 in 2024-09-11T08:33:13.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-09-11T08:33:13.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:13 smithi173 ceph-mon[40835]: osdmap e675: 8 total, 8 up, 8 in 2024-09-11T08:33:14.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:14 smithi175 ceph-mon[32813]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[29664]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]: dispatch 2024-09-11T08:33:14.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:14 smithi173 ceph-mon[40835]: pgmap v1056: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:15.341 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:15.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]': finished 2024-09-11T08:33:15.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:15 smithi175 ceph-mon[32813]: osdmap e676: 8 total, 8 up, 8 in 2024-09-11T08:33:15.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:15 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:15.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]': finished 2024-09-11T08:33:15.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[29664]: osdmap e676: 8 total, 8 up, 8 in 2024-09-11T08:33:15.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-138"}]': finished 2024-09-11T08:33:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[40835]: osdmap e676: 8 total, 8 up, 8 in 2024-09-11T08:33:15.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:15 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:16.617 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:16 smithi173 ceph-mon[29664]: osdmap e677: 8 total, 8 up, 8 in 2024-09-11T08:33:16.618 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:16 smithi173 ceph-mon[29664]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:16.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:16 smithi173 ceph-mon[40835]: osdmap e677: 8 total, 8 up, 8 in 2024-09-11T08:33:16.618 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:16 smithi173 ceph-mon[40835]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:16.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:16 smithi175 ceph-mon[32813]: osdmap e677: 8 total, 8 up, 8 in 2024-09-11T08:33:16.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:16 smithi175 ceph-mon[32813]: pgmap v1059: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:16.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:17.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[40835]: osdmap e678: 8 total, 8 up, 8 in 2024-09-11T08:33:17.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:17.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[29664]: osdmap e678: 8 total, 8 up, 8 in 2024-09-11T08:33:17.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:17.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:17.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:17] "GET /metrics HTTP/1.1" 200 228737 "" "Prometheus/2.43.0" 2024-09-11T08:33:17.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:17 smithi175 ceph-mon[32813]: osdmap e678: 8 total, 8 up, 8 in 2024-09-11T08:33:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: osdmap e679: 8 total, 8 up, 8 in 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[40835]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: osdmap e679: 8 total, 8 up, 8 in 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:18 smithi173 ceph-mon[29664]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: osdmap e679: 8 total, 8 up, 8 in 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:18.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:18 smithi175 ceph-mon[32813]: pgmap v1062: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:19.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[29664]: osdmap e680: 8 total, 8 up, 8 in 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[40835]: osdmap e680: 8 total, 8 up, 8 in 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:19.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:19 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:19 smithi175 ceph-mon[32813]: osdmap e680: 8 total, 8 up, 8 in 2024-09-11T08:33:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:19 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:19.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:19 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]: dispatch 2024-09-11T08:33:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:33:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: osdmap e681: 8 total, 8 up, 8 in 2024-09-11T08:33:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: osdmap e681: 8 total, 8 up, 8 in 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:20.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_count","val": "3"}]': finished 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: osdmap e681: 8 total, 8 up, 8 in 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]: dispatch 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:33:20.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:33:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[29664]: osdmap e682: 8 total, 8 up, 8 in 2024-09-11T08:33:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:33:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[40835]: osdmap e682: 8 total, 8 up, 8 in 2024-09-11T08:33:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:21.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:21 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_period","val": "3"}]': finished 2024-09-11T08:33:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:21 smithi175 ceph-mon[32813]: osdmap e682: 8 total, 8 up, 8 in 2024-09-11T08:33:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:21 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:21.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:21 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:22.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: osdmap e683: 8 total, 8 up, 8 in 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[29664]: osdmap e684: 8 total, 8 up, 8 in 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: osdmap e683: 8 total, 8 up, 8 in 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:33:22.718 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:22 smithi173 ceph-mon[40835]: osdmap e684: 8 total, 8 up, 8 in 2024-09-11T08:33:22.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: pgmap v1067: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: osdmap e683: 8 total, 8 up, 8 in 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-09-11T08:33:22.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:22 smithi175 ceph-mon[32813]: osdmap e684: 8 total, 8 up, 8 in 2024-09-11T08:33:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:24 smithi173 ceph-mon[29664]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:24 smithi173 ceph-mon[40835]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:24.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:24 smithi175 ceph-mon[32813]: pgmap v1070: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:26.556 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:26 smithi175 ceph-mon[32813]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:26 smithi173 ceph-mon[29664]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:26.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:26 smithi173 ceph-mon[40835]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:26.823 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:27 smithi175 ceph-mon[32813]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-11T08:33:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:27] "GET /metrics HTTP/1.1" 200 228737 "" "Prometheus/2.43.0" 2024-09-11T08:33:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:27.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:27 smithi173 ceph-mon[29664]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-11T08:33:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:27 smithi173 ceph-mon[40835]: pgmap v1072: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-11T08:33:29.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:29 smithi175 ceph-mon[32813]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-11T08:33:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:29 smithi173 ceph-mon[29664]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-11T08:33:29.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:29 smithi173 ceph-mon[40835]: pgmap v1073: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-09-11T08:33:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:31 smithi175 ceph-mon[32813]: pgmap v1074: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:31 smithi173 ceph-mon[29664]: pgmap v1074: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:31.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:31 smithi173 ceph-mon[40835]: pgmap v1074: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:33.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:33 smithi175 ceph-mon[32813]: pgmap v1075: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 930 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-11T08:33:33.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:33 smithi173 ceph-mon[29664]: pgmap v1075: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 930 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-11T08:33:33.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:33 smithi173 ceph-mon[40835]: pgmap v1075: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 930 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-09-11T08:33:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:34 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:34.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:34 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:34.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:34 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]: dispatch 2024-09-11T08:33:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]': finished 2024-09-11T08:33:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:35 smithi175 ceph-mon[32813]: osdmap e685: 8 total, 8 up, 8 in 2024-09-11T08:33:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:35 smithi175 ceph-mon[32813]: pgmap v1077: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]': finished 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[29664]: osdmap e685: 8 total, 8 up, 8 in 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[29664]: pgmap v1077: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-140"}]': finished 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[40835]: osdmap e685: 8 total, 8 up, 8 in 2024-09-11T08:33:35.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:35 smithi173 ceph-mon[40835]: pgmap v1077: 204 pgs: 204 active+clean; 4.5 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 7.4 KiB/s wr, 2 op/s 2024-09-11T08:33:36.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:36 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:36 smithi175 ceph-mon[32813]: osdmap e686: 8 total, 8 up, 8 in 2024-09-11T08:33:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:36 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:36 smithi173 ceph-mon[29664]: osdmap e686: 8 total, 8 up, 8 in 2024-09-11T08:33:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:36 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:36 smithi173 ceph-mon[40835]: osdmap e686: 8 total, 8 up, 8 in 2024-09-11T08:33:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:37 smithi175 ceph-mon[32813]: osdmap e687: 8 total, 8 up, 8 in 2024-09-11T08:33:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:37.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:37 smithi175 ceph-mon[32813]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:37] "GET /metrics HTTP/1.1" 200 228749 "" "Prometheus/2.43.0" 2024-09-11T08:33:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[29664]: osdmap e687: 8 total, 8 up, 8 in 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[29664]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[40835]: osdmap e687: 8 total, 8 up, 8 in 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:37 smithi173 ceph-mon[40835]: pgmap v1080: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:33:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:38 smithi175 ceph-mon[32813]: osdmap e688: 8 total, 8 up, 8 in 2024-09-11T08:33:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[29664]: osdmap e688: 8 total, 8 up, 8 in 2024-09-11T08:33:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[40835]: osdmap e688: 8 total, 8 up, 8 in 2024-09-11T08:33:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:39 smithi175 ceph-mon[32813]: osdmap e689: 8 total, 8 up, 8 in 2024-09-11T08:33:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:39 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:39 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:39 smithi175 ceph-mon[32813]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[29664]: osdmap e689: 8 total, 8 up, 8 in 2024-09-11T08:33:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[29664]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[40835]: osdmap e689: 8 total, 8 up, 8 in 2024-09-11T08:33:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:39.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:39 smithi173 ceph-mon[40835]: pgmap v1083: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:40.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:40 smithi175 ceph-mon[32813]: osdmap e690: 8 total, 8 up, 8 in 2024-09-11T08:33:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[29664]: osdmap e690: 8 total, 8 up, 8 in 2024-09-11T08:33:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[40835]: osdmap e690: 8 total, 8 up, 8 in 2024-09-11T08:33:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]: dispatch 2024-09-11T08:33:41.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]': finished 2024-09-11T08:33:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: osdmap e691: 8 total, 8 up, 8 in 2024-09-11T08:33:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:41 smithi175 ceph-mon[32813]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]': finished 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: osdmap e691: 8 total, 8 up, 8 in 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[29664]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-142", "mode": "writeback"}]': finished 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: osdmap e691: 8 total, 8 up, 8 in 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:33:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:41 smithi173 ceph-mon[40835]: pgmap v1086: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:42.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:42 smithi175 ceph-mon[32813]: osdmap e692: 8 total, 8 up, 8 in 2024-09-11T08:33:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:42.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[29664]: osdmap e692: 8 total, 8 up, 8 in 2024-09-11T08:33:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:42.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:33:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[40835]: osdmap e692: 8 total, 8 up, 8 in 2024-09-11T08:33:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:42.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:33:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:43 smithi175 ceph-mon[32813]: osdmap e693: 8 total, 8 up, 8 in 2024-09-11T08:33:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:43 smithi175 ceph-mon[32813]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[29664]: osdmap e693: 8 total, 8 up, 8 in 2024-09-11T08:33:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[29664]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:33:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[40835]: osdmap e693: 8 total, 8 up, 8 in 2024-09-11T08:33:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:33:43.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:43 smithi173 ceph-mon[40835]: pgmap v1089: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-11T08:33:44.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:44 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:44.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:44 smithi175 ceph-mon[32813]: osdmap e694: 8 total, 8 up, 8 in 2024-09-11T08:33:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[29664]: osdmap e694: 8 total, 8 up, 8 in 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:33:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:33:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[40835]: osdmap e694: 8 total, 8 up, 8 in 2024-09-11T08:33:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:33:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: osdmap e695: 8 total, 8 up, 8 in 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:45 smithi175 ceph-mon[32813]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: osdmap e695: 8 total, 8 up, 8 in 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[29664]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: osdmap e695: 8 total, 8 up, 8 in 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:45 smithi173 ceph-mon[40835]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:46.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:33:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:46 smithi175 ceph-mon[32813]: osdmap e696: 8 total, 8 up, 8 in 2024-09-11T08:33:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:46.866 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[29664]: osdmap e696: 8 total, 8 up, 8 in 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[40835]: osdmap e696: 8 total, 8 up, 8 in 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:46.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-09-11T08:33:47.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:33:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: osdmap e697: 8 total, 8 up, 8 in 2024-09-11T08:33:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:47 smithi175 ceph-mon[32813]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:47] "GET /metrics HTTP/1.1" 200 228749 "" "Prometheus/2.43.0" 2024-09-11T08:33:47.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: osdmap e697: 8 total, 8 up, 8 in 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[29664]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: osdmap e697: 8 total, 8 up, 8 in 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:47 smithi173 ceph-mon[40835]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:48.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:48 smithi175 ceph-mon[32813]: osdmap e698: 8 total, 8 up, 8 in 2024-09-11T08:33:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[29664]: osdmap e698: 8 total, 8 up, 8 in 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[40835]: osdmap e698: 8 total, 8 up, 8 in 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:48.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: osdmap e699: 8 total, 8 up, 8 in 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[29664]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: osdmap e699: 8 total, 8 up, 8 in 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:49 smithi173 ceph-mon[40835]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:50.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]': finished 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: osdmap e699: 8 total, 8 up, 8 in 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-142"}]: dispatch 2024-09-11T08:33:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:49 smithi175 ceph-mon[32813]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[29664]: osdmap e700: 8 total, 8 up, 8 in 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[40835]: osdmap e700: 8 total, 8 up, 8 in 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:50 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:50 smithi175 ceph-mon[32813]: osdmap e700: 8 total, 8 up, 8 in 2024-09-11T08:33:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:33:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:50 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[29664]: osdmap e701: 8 total, 8 up, 8 in 2024-09-11T08:33:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[29664]: pgmap v1101: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[40835]: osdmap e701: 8 total, 8 up, 8 in 2024-09-11T08:33:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:51 smithi173 ceph-mon[40835]: pgmap v1101: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:52.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:51 smithi175 ceph-mon[32813]: osdmap e701: 8 total, 8 up, 8 in 2024-09-11T08:33:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:33:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:51 smithi175 ceph-mon[32813]: pgmap v1101: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[29664]: osdmap e702: 8 total, 8 up, 8 in 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[40835]: osdmap e702: 8 total, 8 up, 8 in 2024-09-11T08:33:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:52.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:52 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:53.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:33:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:52 smithi175 ceph-mon[32813]: osdmap e702: 8 total, 8 up, 8 in 2024-09-11T08:33:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:52 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:33:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[29664]: osdmap e703: 8 total, 8 up, 8 in 2024-09-11T08:33:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[29664]: pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[40835]: osdmap e703: 8 total, 8 up, 8 in 2024-09-11T08:33:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:53 smithi173 ceph-mon[40835]: pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:54.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:33:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:53 smithi175 ceph-mon[32813]: osdmap e703: 8 total, 8 up, 8 in 2024-09-11T08:33:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:53 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:33:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:53 smithi175 ceph-mon[32813]: pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-11T08:33:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:33:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[29664]: osdmap e704: 8 total, 8 up, 8 in 2024-09-11T08:33:54.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:54.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:33:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[40835]: osdmap e704: 8 total, 8 up, 8 in 2024-09-11T08:33:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:54.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:54 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:33:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:54 smithi175 ceph-mon[32813]: osdmap e704: 8 total, 8 up, 8 in 2024-09-11T08:33:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:54 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:55.077 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:54 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]: dispatch 2024-09-11T08:33:55.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:33:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]': finished 2024-09-11T08:33:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[29664]: osdmap e705: 8 total, 8 up, 8 in 2024-09-11T08:33:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:55.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[29664]: pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]': finished 2024-09-11T08:33:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[40835]: osdmap e705: 8 total, 8 up, 8 in 2024-09-11T08:33:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:55.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:55 smithi173 ceph-mon[40835]: pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:56.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:33:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-144", "mode": "readproxy"}]': finished 2024-09-11T08:33:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-mon[32813]: osdmap e705: 8 total, 8 up, 8 in 2024-09-11T08:33:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:33:56.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:55 smithi175 ceph-mon[32813]: pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:33:56.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:33:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:33:57.849 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:57.849 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:57 smithi175 ceph-mon[32813]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 176 B/s wr, 1 op/s 2024-09-11T08:33:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:33:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:33:57] "GET /metrics HTTP/1.1" 200 226311 "" "Prometheus/2.43.0" 2024-09-11T08:33:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:57.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:57 smithi173 ceph-mon[40835]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 176 B/s wr, 1 op/s 2024-09-11T08:33:57.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:33:57.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:57 smithi173 ceph-mon[29664]: pgmap v1108: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 176 B/s wr, 1 op/s 2024-09-11T08:33:59.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:33:59 smithi175 ceph-mon[32813]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 905 B/s rd, 150 B/s wr, 1 op/s 2024-09-11T08:33:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:33:59 smithi173 ceph-mon[29664]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 905 B/s rd, 150 B/s wr, 1 op/s 2024-09-11T08:33:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:33:59 smithi173 ceph-mon[40835]: pgmap v1109: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 905 B/s rd, 150 B/s wr, 1 op/s 2024-09-11T08:34:01.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:01 smithi175 ceph-mon[32813]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-11T08:34:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:01 smithi173 ceph-mon[29664]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-11T08:34:01.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:01 smithi173 ceph-mon[40835]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-11T08:34:03.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:03 smithi175 ceph-mon[32813]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-11T08:34:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:03 smithi173 ceph-mon[29664]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-11T08:34:03.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:03 smithi173 ceph-mon[40835]: pgmap v1111: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 104 B/s wr, 1 op/s 2024-09-11T08:34:05.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:05 smithi175 ceph-mon[32813]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 95 B/s wr, 1 op/s 2024-09-11T08:34:06.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:06.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:06.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[40835]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 95 B/s wr, 1 op/s 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:06.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:05 smithi173 ceph-mon[29664]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 95 B/s wr, 1 op/s 2024-09-11T08:34:07.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:06 smithi175 ceph-mon[32813]: osdmap e706: 8 total, 8 up, 8 in 2024-09-11T08:34:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[29664]: osdmap e706: 8 total, 8 up, 8 in 2024-09-11T08:34:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[40835]: osdmap e706: 8 total, 8 up, 8 in 2024-09-11T08:34:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:07.794 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:07] "GET /metrics HTTP/1.1" 200 228709 "" "Prometheus/2.43.0" 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: osdmap e707: 8 total, 8 up, 8 in 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:07 smithi175 ceph-mon[32813]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: osdmap e707: 8 total, 8 up, 8 in 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[29664]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]': finished 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: osdmap e707: 8 total, 8 up, 8 in 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-144"}]: dispatch 2024-09-11T08:34:08.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:07 smithi173 ceph-mon[40835]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:08 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:09.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:08 smithi175 ceph-mon[32813]: osdmap e708: 8 total, 8 up, 8 in 2024-09-11T08:34:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:08 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:08 smithi173 ceph-mon[29664]: osdmap e708: 8 total, 8 up, 8 in 2024-09-11T08:34:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:08 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:08 smithi173 ceph-mon[40835]: osdmap e708: 8 total, 8 up, 8 in 2024-09-11T08:34:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:09 smithi175 ceph-mon[32813]: osdmap e709: 8 total, 8 up, 8 in 2024-09-11T08:34:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:09 smithi175 ceph-mon[32813]: pgmap v1118: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[40835]: osdmap e709: 8 total, 8 up, 8 in 2024-09-11T08:34:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[40835]: pgmap v1118: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[29664]: osdmap e709: 8 total, 8 up, 8 in 2024-09-11T08:34:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:10.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:09 smithi173 ceph-mon[29664]: pgmap v1118: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:10 smithi175 ceph-mon[32813]: osdmap e710: 8 total, 8 up, 8 in 2024-09-11T08:34:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:11.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:10 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[29664]: osdmap e710: 8 total, 8 up, 8 in 2024-09-11T08:34:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[40835]: osdmap e710: 8 total, 8 up, 8 in 2024-09-11T08:34:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:11.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:10 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: osdmap e711: 8 total, 8 up, 8 in 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: pgmap v1121: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:11 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: osdmap e711: 8 total, 8 up, 8 in 2024-09-11T08:34:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: pgmap v1121: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: osdmap e711: 8 total, 8 up, 8 in 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: pgmap v1121: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:12.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:11 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: osdmap e712: 8 total, 8 up, 8 in 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:34:13.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:34:13.095 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:13.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:13.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: osdmap e712: 8 total, 8 up, 8 in 2024-09-11T08:34:13.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi173-80673-111", "overlaypool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: osdmap e712: 8 total, 8 up, 8 in 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:34:13.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]': finished 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: osdmap e713: 8 total, 8 up, 8 in 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:13 smithi175 ceph-mon[32813]: pgmap v1124: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]': finished 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: osdmap e713: 8 total, 8 up, 8 in 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[29664]: pgmap v1124: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi173-80673-146", "mode": "writeback"}]': finished 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: osdmap e713: 8 total, 8 up, 8 in 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]: dispatch 2024-09-11T08:34:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:13 smithi173 ceph-mon[40835]: pgmap v1124: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-11T08:34:15.093 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:15.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:34:15.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:14 smithi175 ceph-mon[32813]: osdmap e714: 8 total, 8 up, 8 in 2024-09-11T08:34:15.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:14 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:15.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:14 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:34:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[29664]: osdmap e714: 8 total, 8 up, 8 in 2024-09-11T08:34:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:15.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_count","val": "2"}]': finished 2024-09-11T08:34:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[40835]: osdmap e714: 8 total, 8 up, 8 in 2024-09-11T08:34:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:15.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:14 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]: dispatch 2024-09-11T08:34:16.117 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: osdmap e715: 8 total, 8 up, 8 in 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[29664]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: osdmap e715: 8 total, 8 up, 8 in 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:16.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:15 smithi173 ceph-mon[40835]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:16.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_period","val": "600"}]': finished 2024-09-11T08:34:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: osdmap e715: 8 total, 8 up, 8 in 2024-09-11T08:34:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-09-11T08:34:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:16.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:15 smithi175 ceph-mon[32813]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:16.850 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:34:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[29664]: osdmap e716: 8 total, 8 up, 8 in 2024-09-11T08:34:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:34:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[40835]: osdmap e716: 8 total, 8 up, 8 in 2024-09-11T08:34:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:16 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-09-11T08:34:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "hit_set_type","val": "bloom"}]': finished 2024-09-11T08:34:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-mon[32813]: osdmap e716: 8 total, 8 up, 8 in 2024-09-11T08:34:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:16 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-09-11T08:34:17.865 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:17] "GET /metrics HTTP/1.1" 200 228709 "" "Prometheus/2.43.0" 2024-09-11T08:34:18.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:18.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:34:18.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: osdmap e717: 8 total, 8 up, 8 in 2024-09-11T08:34:18.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[29664]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: osdmap e717: 8 total, 8 up, 8 in 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:17 smithi173 ceph-mon[40835]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: osdmap e717: 8 total, 8 up, 8 in 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]: dispatch 2024-09-11T08:34:18.234 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:17 smithi175 ceph-mon[32813]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:18.594 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:34:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=sqlstore.transactions t=2024-09-11T08:34:18.23508298Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-11T08:34:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:18 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:34:19.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:18 smithi173 ceph-mon[29664]: osdmap e718: 8 total, 8 up, 8 in 2024-09-11T08:34:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:18 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:34:19.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:18 smithi173 ceph-mon[40835]: osdmap e718: 8 total, 8 up, 8 in 2024-09-11T08:34:19.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:18 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-146","var": "target_max_objects","val": "1"}]': finished 2024-09-11T08:34:19.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:18 smithi175 ceph-mon[32813]: osdmap e718: 8 total, 8 up, 8 in 2024-09-11T08:34:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[29664]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:20.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[40835]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:20.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:19 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:20.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:19 smithi175 ceph-mon[32813]: pgmap v1132: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:20.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:34:20.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:19 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:21.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:20 smithi173 ceph-mon[29664]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:34:21.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:20 smithi173 ceph-mon[40835]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:34:21.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:20 smithi175 ceph-mon[32813]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-09-11T08:34:22.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:21 smithi173 ceph-mon[29664]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:22.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:21 smithi173 ceph-mon[40835]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:22.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:21 smithi175 ceph-mon[32813]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-11T08:34:23.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:23 smithi175 ceph-mon[32813]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:23.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:23 smithi173 ceph-mon[29664]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:23.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:23 smithi173 ceph-mon[40835]: pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 677 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:25.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:25 smithi175 ceph-mon[32813]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 599 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:25.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:25 smithi173 ceph-mon[29664]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 599 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:25.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:25 smithi173 ceph-mon[40835]: pgmap v1135: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 599 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T08:34:27.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:27.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:27 smithi175 ceph-mon[32813]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:27 smithi173 ceph-mon[29664]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:27] "GET /metrics HTTP/1.1" 200 228762 "" "Prometheus/2.43.0" 2024-09-11T08:34:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:27.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:27 smithi173 ceph-mon[40835]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:28.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:28 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:28 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:28.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:28.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:28 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:29.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:29 smithi175 ceph-mon[32813]: osdmap e719: 8 total, 8 up, 8 in 2024-09-11T08:34:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:29 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:29 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:29 smithi175 ceph-mon[32813]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[29664]: osdmap e719: 8 total, 8 up, 8 in 2024-09-11T08:34:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[29664]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[40835]: osdmap e719: 8 total, 8 up, 8 in 2024-09-11T08:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:29.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:29 smithi173 ceph-mon[40835]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-09-11T08:34:31.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: osdmap e720: 8 total, 8 up, 8 in 2024-09-11T08:34:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:31.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:30 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: osdmap e720: 8 total, 8 up, 8 in 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:31.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]': finished 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: osdmap e720: 8 total, 8 up, 8 in 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:31.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:30 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-146"}]: dispatch 2024-09-11T08:34:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:31 smithi175 ceph-mon[32813]: osdmap e721: 8 total, 8 up, 8 in 2024-09-11T08:34:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:31 smithi175 ceph-mon[32813]: pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:34:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:31 smithi175 ceph-mon[32813]: osdmap e722: 8 total, 8 up, 8 in 2024-09-11T08:34:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:31 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:32.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:31 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[29664]: osdmap e721: 8 total, 8 up, 8 in 2024-09-11T08:34:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[29664]: pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:34:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[29664]: osdmap e722: 8 total, 8 up, 8 in 2024-09-11T08:34:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:32.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[40835]: osdmap e721: 8 total, 8 up, 8 in 2024-09-11T08:34:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[40835]: pgmap v1141: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:34:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[40835]: osdmap e722: 8 total, 8 up, 8 in 2024-09-11T08:34:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:32.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:31 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:32 smithi175 ceph-mon[32813]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:34:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:32 smithi175 ceph-mon[32813]: osdmap e723: 8 total, 8 up, 8 in 2024-09-11T08:34:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:32 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:33.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:32 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[29664]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:34:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[29664]: osdmap e723: 8 total, 8 up, 8 in 2024-09-11T08:34:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:33.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[40835]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-09-11T08:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[40835]: osdmap e723: 8 total, 8 up, 8 in 2024-09-11T08:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:33.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:32 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-09-11T08:34:34.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:33 smithi175 ceph-mon[32813]: pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:34:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:33 smithi175 ceph-mon[32813]: osdmap e724: 8 total, 8 up, 8 in 2024-09-11T08:34:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:33 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:34.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:33 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:34.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[29664]: pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:34:34.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[29664]: osdmap e724: 8 total, 8 up, 8 in 2024-09-11T08:34:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:34.217 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:34.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[40835]: pgmap v1144: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T08:34:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148", "force_nonempty": "--force-nonempty" }]': finished 2024-09-11T08:34:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[40835]: osdmap e724: 8 total, 8 up, 8 in 2024-09-11T08:34:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:34.218 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:33 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]': finished 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: osdmap e725: 8 total, 8 up, 8 in 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:35.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:35 smithi175 ceph-mon[32813]: pgmap v1147: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]': finished 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: osdmap e725: 8 total, 8 up, 8 in 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[29664]: pgmap v1147: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]': finished 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: osdmap e725: 8 total, 8 up, 8 in 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:35.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-148"}]: dispatch 2024-09-11T08:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:35.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:35 smithi173 ceph-mon[40835]: pgmap v1147: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:36.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:36 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:36 smithi175 ceph-mon[32813]: osdmap e726: 8 total, 8 up, 8 in 2024-09-11T08:34:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:36 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:36.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:36 smithi173 ceph-mon[29664]: osdmap e726: 8 total, 8 up, 8 in 2024-09-11T08:34:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:36 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:36 smithi173 ceph-mon[40835]: osdmap e726: 8 total, 8 up, 8 in 2024-09-11T08:34:37.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:37 smithi175 ceph-mon[32813]: osdmap e727: 8 total, 8 up, 8 in 2024-09-11T08:34:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:37 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:37 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:37.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:37 smithi175 ceph-mon[32813]: pgmap v1150: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:37] "GET /metrics HTTP/1.1" 200 228694 "" "Prometheus/2.43.0" 2024-09-11T08:34:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[29664]: osdmap e727: 8 total, 8 up, 8 in 2024-09-11T08:34:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[29664]: pgmap v1150: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[40835]: osdmap e727: 8 total, 8 up, 8 in 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:37 smithi173 ceph-mon[40835]: pgmap v1150: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:38.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: osdmap e728: 8 total, 8 up, 8 in 2024-09-11T08:34:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:38.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:38 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: osdmap e728: 8 total, 8 up, 8 in 2024-09-11T08:34:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: osdmap e728: 8 total, 8 up, 8 in 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:38.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:38 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-150"}]: dispatch 2024-09-11T08:34:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:39 smithi175 ceph-mon[32813]: osdmap e729: 8 total, 8 up, 8 in 2024-09-11T08:34:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:39 smithi175 ceph-mon[32813]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:39 smithi173 ceph-mon[29664]: osdmap e729: 8 total, 8 up, 8 in 2024-09-11T08:34:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:39 smithi173 ceph-mon[29664]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:39 smithi173 ceph-mon[40835]: osdmap e729: 8 total, 8 up, 8 in 2024-09-11T08:34:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:39 smithi173 ceph-mon[40835]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T08:34:40.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:40 smithi175 ceph-mon[32813]: osdmap e730: 8 total, 8 up, 8 in 2024-09-11T08:34:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:40 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:40.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:40 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[29664]: osdmap e730: 8 total, 8 up, 8 in 2024-09-11T08:34:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:40.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[40835]: osdmap e730: 8 total, 8 up, 8 in 2024-09-11T08:34:40.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:40.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:40 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: osdmap e731: 8 total, 8 up, 8 in 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:41 smithi175 ceph-mon[32813]: pgmap v1156: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: osdmap e731: 8 total, 8 up, 8 in 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[29664]: pgmap v1156: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: osdmap e731: 8 total, 8 up, 8 in 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-152"}]: dispatch 2024-09-11T08:34:41.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:41 smithi173 ceph-mon[40835]: pgmap v1156: 204 pgs: 204 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T08:34:42.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:42 smithi175 ceph-mon[32813]: osdmap e732: 8 total, 8 up, 8 in 2024-09-11T08:34:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:42 smithi173 ceph-mon[29664]: osdmap e732: 8 total, 8 up, 8 in 2024-09-11T08:34:42.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:42 smithi173 ceph-mon[40835]: osdmap e732: 8 total, 8 up, 8 in 2024-09-11T08:34:43.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:43 smithi175 ceph-mon[32813]: osdmap e733: 8 total, 8 up, 8 in 2024-09-11T08:34:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:43 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:43 smithi175 ceph-mon[32813]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-11T08:34:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[29664]: osdmap e733: 8 total, 8 up, 8 in 2024-09-11T08:34:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[29664]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-11T08:34:43.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[40835]: osdmap e733: 8 total, 8 up, 8 in 2024-09-11T08:34:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-09-11T08:34:43.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:43 smithi173 ceph-mon[40835]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-11T08:34:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: osdmap e734: 8 total, 8 up, 8 in 2024-09-11T08:34:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.845 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:44 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: osdmap e734: 8 total, 8 up, 8 in 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi173-80673-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: osdmap e734: 8 total, 8 up, 8 in 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi173-80673-111","var": "dedup_tier","val": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:44.968 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:44 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi173-80673-111", "tierpool": "test-rados-api-smithi173-80673-154"}]: dispatch 2024-09-11T08:34:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:45.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:45 smithi175 ceph-mon[32813]: osdmap e735: 8 total, 8 up, 8 in 2024-09-11T08:34:45.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:45 smithi175 ceph-mon[32813]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:45 smithi173 ceph-mon[29664]: osdmap e735: 8 total, 8 up, 8 in 2024-09-11T08:34:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:45 smithi173 ceph-mon[29664]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:45.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:45 smithi173 ceph-mon[40835]: osdmap e735: 8 total, 8 up, 8 in 2024-09-11T08:34:45.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:45 smithi173 ceph-mon[40835]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:46 smithi175 ceph-mon[32813]: osdmap e736: 8 total, 8 up, 8 in 2024-09-11T08:34:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:46 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:46.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:46 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:46.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[29664]: osdmap e736: 8 total, 8 up, 8 in 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[40835]: osdmap e736: 8 total, 8 up, 8 in 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:46.868 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:46 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.603 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7807 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12188 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8060 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13086 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7685 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8056 ms) 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: hmm, no HitSet yet 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: ok, hit_set contains 255:602f83fe:::foo:head 2024-09-11T08:34:47.604 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9055 ms) 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: first is 1726043603 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,1726043611,1726043612,0 2024-09-11T08:34:47.605 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,1726043611,1726043612,0 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043603,1726043605,1726043606,1726043608,1726043609,1726043611,1726043612,0 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: got ls 1726043606,1726043608,1726043609,1726043611,1726043612,1726043614,1726043615,0 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: first now 1726043606, trimmed 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20159 ms) 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: foo0 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14103 ms) 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18197 ms) 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22701 ms) 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T08:34:47.606 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5011 ms) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3025 ms) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3022 ms) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3022 ms) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (229696 ms total) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (849164 ms total) 2024-09-11T08:34:47.607 INFO:tasks.workunit.client.0.smithi173.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80310 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80310 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80544 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80544 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81053 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 81053 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.611 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80781 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80781 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80635 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80635 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80390 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80390 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80684 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80684 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80452 2024-09-11T08:34:47.612 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80452 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80983 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80983 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80284 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80284 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80348 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80348 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81012 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 81012 2024-09-11T08:34:47.613 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80275 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80275 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80295 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80295 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80588 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80588 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.614 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80662 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80662 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80621 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80621 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=81032 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 81032 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80940 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80940 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80495 2024-09-11T08:34:47.615 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80495 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80833 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80833 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80268 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80268 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80326 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80326 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80703 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80703 2024-09-11T08:34:47.616 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80366 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80366 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80899 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80899 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ for t in "${!pids[@]}" 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=80922 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 80922 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ exit 0 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ cleanup 2024-09-11T08:34:47.617 INFO:tasks.workunit.client.0.smithi173.stderr:+ pkill -P 80263 2024-09-11T08:34:47.664 INFO:tasks.workunit.client.0.smithi173.stderr:+ true 2024-09-11T08:34:47.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T08:34:47.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T08:34:47.697 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-11T08:34:47.698 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-11T08:34:47.698 DEBUG:teuthology.orchestra.run.smithi173:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d0e6828a2016d48cf25ad84064e50742bb1c39b9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-11T08:34:47.759 INFO:tasks.workunit.client.0.smithi173.stderr:++ uuidgen 2024-09-11T08:34:47.776 INFO:tasks.workunit.client.0.smithi173.stderr:+ p=6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:34:47.776 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool create 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 12 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: osdmap e737: 8 total, 8 up, 8 in 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:47.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:47 smithi175 ceph-mon[32813]: pgmap v1165: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:47.856 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 -- 172.21.15.173:0/3879047087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 msgr2=0x7fa9900666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 --2- 172.21.15.173:0/3879047087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa9900666b0 secure :-1 s=READY pgs=2903 cs=0 l=1 rev1=1 crypto rx=0x7fa980004950 tx=0x7fa980009da0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 -- 172.21.15.173:0/3879047087 shutdown_connections 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 --2- 172.21.15.173:0/3879047087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa990108f70 0x7fa99010b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 --2- 172.21.15.173:0/3879047087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa9900666b0 unknown :-1 s=CLOSED pgs=2903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 --2- 172.21.15.173:0/3879047087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9900fd650 0x7fa990065c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 -- 172.21.15.173:0/3879047087 >> 172.21.15.173:0/3879047087 conn(0x7fa990072600 msgr2=0x7fa990072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 -- 172.21.15.173:0/3879047087 shutdown_connections 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.855+0000 7fa996b9d640 1 -- 172.21.15.173:0/3879047087 wait complete. 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 Processor -- start 2024-09-11T08:34:47.857 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 -- start start 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990108f70 0x7fa99010f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99010f690 con 0x7fa9900fd650 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99010f800 con 0x7fa990108f70 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa996b9d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99010f9c0 con 0x7fa990066240 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa994939640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56562/0 (socket says 172.21.15.173:56562) 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa994939640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:51218/0 (socket says 172.21.15.173:51218) 2024-09-11T08:34:47.860 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 -- 172.21.15.173:0/1488427008 learned_addr learned my addr 172.21.15.173:0/1488427008 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa99513a640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990108f70 0x7fa99010f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 -- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 msgr2=0x7fa990114eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 -- 172.21.15.173:0/1488427008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990108f70 msgr2=0x7fa99010f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990108f70 0x7fa99010f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa987fff640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880098b0 con 0x7fa9900fd650 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.856+0000 7fa994939640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa987fff640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fa9800043d0 tx=0x7fa980035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:47.861 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800090d0 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa980005040 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fa980009230 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98003c410 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.857+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99011bd00 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.858+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99004bf60 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.858+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fa980030020 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.859+0000 7fa9857fa640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 0x7fa978071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.859+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(738..738 src has 1..738) v4 ==== 8584+0+0 (secure 0 0 0) 0x7fa9800ae9e0 con 0x7fa9900fd650 2024-09-11T08:34:47.862 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.859+0000 7fa994939640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 0x7fa978071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:47.863 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.859+0000 7fa994939640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 0x7fa978071470 secure :-1 s=READY pgs=3604 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009f30 tx=0x7fa98c009120 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:47.864 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:47.863+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa98007af40 con 0x7fa9900fd650 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:47] "GET /metrics HTTP/1.1" 200 228694 "" "Prometheus/2.43.0" 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: osdmap e737: 8 total, 8 up, 8 in 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[40835]: pgmap v1165: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: osdmap e737: 8 total, 8 up, 8 in 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2356571581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]: dispatch 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:47.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:47 smithi173 ceph-mon[29664]: pgmap v1165: 164 pgs: 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:48.022 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.021+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12} v 0) v1 -- 0x7fa99010dd20 con 0x7fa9900fd650 2024-09-11T08:34:48.604 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.603+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]=0 pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' created v739) v1 ==== 176+0+0 (secure 0 0 0) 0x7fa98007a8e0 con 0x7fa9900fd650 2024-09-11T08:34:48.702 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.700+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12} v 0) v1 -- 0x7fa990110520 con 0x7fa9900fd650 2024-09-11T08:34:48.702 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.701+0000 7fa9857fa640 1 -- 172.21.15.173:0/1488427008 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]=0 pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' already exists v739) v1 ==== 183+0+0 (secure 0 0 0) 0x7fa98007aac0 con 0x7fa9900fd650 2024-09-11T08:34:48.702 INFO:tasks.workunit.client.0.smithi173.stderr:pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' already exists 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 msgr2=0x7fa978071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 0x7fa978071470 secure :-1 s=READY pgs=3604 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009f30 tx=0x7fa98c009120 comp rx=0 tx=0).stop 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 msgr2=0x7fa9901153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fa9800043d0 tx=0x7fa980035040 comp rx=0 tx=0).stop 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 shutdown_connections 2024-09-11T08:34:48.704 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fa97806efc0 0x7fa978071470 unknown :-1 s=CLOSED pgs=3604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990108f70 0x7fa99010f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9900fd650 0x7fa9901153f0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 --2- 172.21.15.173:0/1488427008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa990066240 0x7fa990114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 >> 172.21.15.173:0/1488427008 conn(0x7fa990072600 msgr2=0x7fa9900fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 shutdown_connections 2024-09-11T08:34:48.705 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.703+0000 7fa996b9d640 1 -- 172.21.15.173:0/1488427008 wait complete. 2024-09-11T08:34:48.713 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_objects 10 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 -- 172.21.15.173:0/3132887119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6841015f0 msgr2=0x7ff6841019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 --2- 172.21.15.173:0/3132887119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6841015f0 0x7ff6841019c0 secure :-1 s=READY pgs=2904 cs=0 l=1 rev1=1 crypto rx=0x7ff680009cd0 tx=0x7ff680004d10 comp rx=0 tx=0).stop 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 -- 172.21.15.173:0/3132887119 shutdown_connections 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 --2- 172.21.15.173:0/3132887119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6840fbd30 0x7ff6841083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 --2- 172.21.15.173:0/3132887119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff6840fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 --2- 172.21.15.173:0/3132887119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6841015f0 0x7ff6841019c0 unknown :-1 s=CLOSED pgs=2904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 -- 172.21.15.173:0/3132887119 >> 172.21.15.173:0/3132887119 conn(0x7ff684072510 msgr2=0x7ff6840f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.789+0000 7ff68c71d640 1 -- 172.21.15.173:0/3132887119 shutdown_connections 2024-09-11T08:34:48.794 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 -- 172.21.15.173:0/3132887119 wait complete. 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 Processor -- start 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 -- start start 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 0x7ff684113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff68410cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68410d2b0 con 0x7ff684101f90 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68410d420 con 0x7ff6841015f0 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68c71d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68410d5e0 con 0x7ff6840fbd30 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68a4b9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68acba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff68410cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:48.795 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68a4b9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:51230/0 (socket says 172.21.15.173:51230) 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff68a4b9640 1 -- 172.21.15.173:0/2951050325 learned_addr learned my addr 172.21.15.173:0/2951050325 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.790+0000 7ff689cb8640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 0x7ff684113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 -- 172.21.15.173:0/2951050325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 msgr2=0x7ff684113010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 0x7ff684113010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 -- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 msgr2=0x7ff68410cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff68410cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674005040 con 0x7ff6840fbd30 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff689cb8640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 0x7ff684113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68acba640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff68410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68a4b9640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 crypto rx=0x7ff680009d30 tx=0x7ff680004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:48.796 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680038070 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800098b0 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7ff6800090d0 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68003c620 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.791+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6840fd160 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.792+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68404bf60 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.792+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7ff680030070 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.793+0000 7ff67affd640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 0x7ff670071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.793+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(739..739 src has 1..739) v4 ==== 8959+0+0 (secure 0 0 0) 0x7ff6800af190 con 0x7ff6840fbd30 2024-09-11T08:34:48.797 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.793+0000 7ff689cb8640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 0x7ff670071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:48.798 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.793+0000 7ff689cb8640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 0x7ff670071470 secure :-1 s=READY pgs=3605 cs=0 l=1 rev1=1 crypto rx=0x7ff674009fd0 tx=0x7ff674009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:48.798 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.797+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff68007b580 con 0x7ff6840fbd30 2024-09-11T08:34:48.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:48 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:48 smithi175 ceph-mon[32813]: osdmap e738: 8 total, 8 up, 8 in 2024-09-11T08:34:48.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:48 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:48.956 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:48.955+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7ff6840654a0 con 0x7ff6840fbd30 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[29664]: osdmap e738: 8 total, 8 up, 8 in 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi173-80673-111"}]': finished 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[40835]: osdmap e738: 8 total, 8 up, 8 in 2024-09-11T08:34:48.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:48 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:49.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:49.615+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v740) v1 ==== 223+0+0 (secure 0 0 0) 0x7ff6800410d0 con 0x7ff6840fbd30 2024-09-11T08:34:49.716 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:49.715+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7ff68410e140 con 0x7ff6840fbd30 2024-09-11T08:34:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]': finished 2024-09-11T08:34:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: osdmap e739: 8 total, 8 up, 8 in 2024-09-11T08:34:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[29664]: pgmap v1168: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]': finished 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: osdmap e739: 8 total, 8 up, 8 in 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:49.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:49 smithi173 ceph-mon[40835]: pgmap v1168: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:50.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]': finished 2024-09-11T08:34:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: osdmap e739: 8 total, 8 up, 8 in 2024-09-11T08:34:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1488427008' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pg_num": 12}]: dispatch 2024-09-11T08:34:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:49 smithi175 ceph-mon[32813]: pgmap v1168: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:34:50.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.615+0000 7ff67affd640 1 -- 172.21.15.173:0/2951050325 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v741) v1 ==== 223+0+0 (secure 0 0 0) 0x7ff68007af20 con 0x7ff6840fbd30 2024-09-11T08:34:50.617 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_objects = 10 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 msgr2=0x7ff670071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 0x7ff670071470 secure :-1 s=READY pgs=3605 cs=0 l=1 rev1=1 crypto rx=0x7ff674009fd0 tx=0x7ff674009da0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 msgr2=0x7ff684112ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 crypto rx=0x7ff680009d30 tx=0x7ff680004d10 comp rx=0 tx=0).stop 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 shutdown_connections 2024-09-11T08:34:50.619 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7ff67006efc0 0x7ff670071470 unknown :-1 s=CLOSED pgs=3605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff684101f90 0x7ff68410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6841015f0 0x7ff684113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 --2- 172.21.15.173:0/2951050325 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6840fbd30 0x7ff684112ad0 unknown :-1 s=CLOSED pgs=2905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 >> 172.21.15.173:0/2951050325 conn(0x7ff684072510 msgr2=0x7ff684065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 shutdown_connections 2024-09-11T08:34:50.620 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.618+0000 7ff68c71d640 1 -- 172.21.15.173:0/2951050325 wait complete. 2024-09-11T08:34:50.629 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool application enable 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea rados 2024-09-11T08:34:50.709 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 -- 172.21.15.173:0/1521163974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c102720 msgr2=0x7f299c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:50.709 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 --2- 172.21.15.173:0/1521163974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c102720 0x7f299c102af0 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 crypto rx=0x7f2998004950 tx=0x7f2998009da0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.709 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 -- 172.21.15.173:0/1521163974 shutdown_connections 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 --2- 172.21.15.173:0/1521163974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c0fb350 0x7f299c109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 --2- 172.21.15.173:0/1521163974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c1030c0 0x7f299c0fac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 --2- 172.21.15.173:0/1521163974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c102720 0x7f299c102af0 unknown :-1 s=CLOSED pgs=2906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 -- 172.21.15.173:0/1521163974 >> 172.21.15.173:0/1521163974 conn(0x7f299c074bb0 msgr2=0x7f299c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 -- 172.21.15.173:0/1521163974 shutdown_connections 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.706+0000 7f29a424f640 1 -- 172.21.15.173:0/1521163974 wait complete. 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 Processor -- start 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 -- start start 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c102720 0x7f299c112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c10d1d0 con 0x7f299c1030c0 2024-09-11T08:34:50.710 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c10d340 con 0x7f299c102720 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a424f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c10d500 con 0x7f299c0fb350 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a1feb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56598/0 (socket says 172.21.15.173:56598) 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 -- 172.21.15.173:0/4042194270 learned_addr learned my addr 172.21.15.173:0/4042194270 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a1feb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:51252/0 (socket says 172.21.15.173:51252) 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a17ea640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c102720 0x7f299c112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 -- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 msgr2=0x7f299c1129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.711 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 -- 172.21.15.173:0/4042194270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c102720 msgr2=0x7f299c112f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c102720 0x7f299c112f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940098b0 con 0x7f299c1030c0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a1feb640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.707+0000 7f29a27ec640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f2994001eb0 tx=0x7f2994004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.708+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400fea0 con 0x7f299c1030c0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.708+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2998005040 con 0x7f299c1030c0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.708+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f2994007cd0 con 0x7f299c1030c0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.708+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994009720 con 0x7f299c1030c0 2024-09-11T08:34:50.712 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.708+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1197f0 con 0x7f299c1030c0 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.709+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0fdf40 con 0x7f299c1030c0 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.709+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f2994007890 con 0x7f299c1030c0 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.710+0000 7f29927fc640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 0x7f2988071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.710+0000 7f29a1feb640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 0x7f2988071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.710+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(741..741 src has 1..741) v4 ==== 8959+0+0 (secure 0 0 0) 0x7f299408f190 con 0x7f299c1030c0 2024-09-11T08:34:50.713 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.710+0000 7f29a1feb640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 0x7f2988071470 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 crypto rx=0x7f2998009040 tx=0x7f2998035040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:34:50.715 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.714+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f299405b580 con 0x7f299c1030c0 2024-09-11T08:34:50.870 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:50.869+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"} v 0) v1 -- 0x7f299c10b950 con 0x7f299c1030c0 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: osdmap e740: 8 total, 8 up, 8 in 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: osdmap e740: 8 total, 8 up, 8 in 2024-09-11T08:34:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:50.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:51.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: osdmap e740: 8 total, 8 up, 8 in 2024-09-11T08:34:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2951050325' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:34:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:34:51.623 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:51.622+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]=0 enabled application 'rados' on pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' v742) v1 ==== 213+0+0 (secure 0 0 0) 0x7f299405af20 con 0x7f299c1030c0 2024-09-11T08:34:51.720 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:51.719+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"} v 0) v1 -- 0x7f299c04bfe0 con 0x7f299c1030c0 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[29664]: osdmap e741: 8 total, 8 up, 8 in 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[29664]: pgmap v1171: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[40835]: osdmap e741: 8 total, 8 up, 8 in 2024-09-11T08:34:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:51.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:51 smithi173 ceph-mon[40835]: pgmap v1171: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:52.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:51 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:34:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:51 smithi175 ceph-mon[32813]: osdmap e741: 8 total, 8 up, 8 in 2024-09-11T08:34:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:51 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:52.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:51 smithi175 ceph-mon[32813]: pgmap v1171: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:52.625 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.624+0000 7f29927fc640 1 -- 172.21.15.173:0/4042194270 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]=0 enabled application 'rados' on pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' v743) v1 ==== 213+0+0 (secure 0 0 0) 0x7f299401a030 con 0x7f299c1030c0 2024-09-11T08:34:52.626 INFO:tasks.workunit.client.0.smithi173.stderr:enabled application 'rados' on pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' 2024-09-11T08:34:52.628 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 msgr2=0x7f2988071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:52.628 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 0x7f2988071470 secure :-1 s=READY pgs=3606 cs=0 l=1 rev1=1 crypto rx=0x7f2998009040 tx=0x7f2998035040 comp rx=0 tx=0).stop 2024-09-11T08:34:52.628 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 msgr2=0x7f299c10cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:34:52.628 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f2994001eb0 tx=0x7f2994004c50 comp rx=0 tx=0).stop 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 shutdown_connections 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f298806efc0 0x7f2988071470 unknown :-1 s=CLOSED pgs=3606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f299c1030c0 0x7f299c10cb80 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c102720 0x7f299c112f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 --2- 172.21.15.173:0/4042194270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f299c0fb350 0x7f299c1129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 >> 172.21.15.173:0/4042194270 conn(0x7f299c074bb0 msgr2=0x7f299c1002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 shutdown_connections 2024-09-11T08:34:52.629 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:34:52.627+0000 7f29a424f640 1 -- 172.21.15.173:0/4042194270 wait complete. 2024-09-11T08:34:52.642 INFO:tasks.workunit.client.0.smithi173.stderr:++ seq 1 10 2024-09-11T08:34:52.651 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.651 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj1 /etc/passwd 2024-09-11T08:34:52.685 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.686 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj2 /etc/passwd 2024-09-11T08:34:52.721 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.722 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj3 /etc/passwd 2024-09-11T08:34:52.753 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.753 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj4 /etc/passwd 2024-09-11T08:34:52.784 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.784 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj5 /etc/passwd 2024-09-11T08:34:52.814 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.814 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj6 /etc/passwd 2024-09-11T08:34:52.845 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.845 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj7 /etc/passwd 2024-09-11T08:34:52.875 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.876 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj8 /etc/passwd 2024-09-11T08:34:52.906 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.906 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj9 /etc/passwd 2024-09-11T08:34:52.937 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:34:52.937 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put obj10 /etc/passwd 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[29664]: osdmap e742: 8 total, 8 up, 8 in 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[40835]: osdmap e742: 8 total, 8 up, 8 in 2024-09-11T08:34:52.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:52 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:52.967 INFO:tasks.workunit.client.0.smithi173.stderr:+ sleep 30 2024-09-11T08:34:53.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:52 smithi175 ceph-mon[32813]: osdmap e742: 8 total, 8 up, 8 in 2024-09-11T08:34:53.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:52 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]: dispatch 2024-09-11T08:34:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[29664]: osdmap e743: 8 total, 8 up, 8 in 2024-09-11T08:34:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[29664]: pgmap v1174: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:53.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:53.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[40835]: osdmap e743: 8 total, 8 up, 8 in 2024-09-11T08:34:53.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:53 smithi173 ceph-mon[40835]: pgmap v1174: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:54.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:53 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4042194270' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "app": "rados"}]': finished 2024-09-11T08:34:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:53 smithi175 ceph-mon[32813]: osdmap e743: 8 total, 8 up, 8 in 2024-09-11T08:34:54.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:53 smithi175 ceph-mon[32813]: pgmap v1174: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:34:55.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:55 smithi175 ceph-mon[32813]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:55.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:34:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:34:55.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:55 smithi173 ceph-mon[29664]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:55.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:55 smithi173 ceph-mon[40835]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T08:34:56.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:56 smithi175 ceph-mon[32813]: pgmap v1175: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-09-11T08:34:56.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:56 smithi173 ceph-mon[29664]: pgmap v1175: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-09-11T08:34:56.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:56 smithi173 ceph-mon[40835]: pgmap v1175: 176 pgs: 176 active+clean; 582 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2024-09-11T08:34:57.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:34:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:34:57.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:57.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:57 smithi175 ceph-mon[32813]: pgmap v1176: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-11T08:34:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:57 smithi173 ceph-mon[29664]: pgmap v1176: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-11T08:34:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:34:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:34:57] "GET /metrics HTTP/1.1" 200 226265 "" "Prometheus/2.43.0" 2024-09-11T08:34:57.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:34:57.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:57 smithi173 ceph-mon[40835]: pgmap v1176: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-11T08:34:59.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:34:59 smithi175 ceph-mon[32813]: pgmap v1177: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-11T08:34:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:34:59 smithi173 ceph-mon[29664]: pgmap v1177: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-11T08:34:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:34:59 smithi173 ceph-mon[40835]: pgmap v1177: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 16 KiB/s wr, 1 op/s 2024-09-11T08:35:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:00 smithi175 ceph-mon[32813]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_objects: 10) 2024-09-11T08:35:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:00 smithi175 ceph-mon[32813]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:00 smithi175 ceph-mon[32813]: osdmap e744: 8 total, 8 up, 8 in 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[29664]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_objects: 10) 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[29664]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[29664]: osdmap e744: 8 total, 8 up, 8 in 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[40835]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_objects: 10) 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[40835]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:00.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:00 smithi173 ceph-mon[40835]: osdmap e744: 8 total, 8 up, 8 in 2024-09-11T08:35:01.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:01 smithi175 ceph-mon[32813]: pgmap v1179: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-11T08:35:01.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:01 smithi173 ceph-mon[29664]: pgmap v1179: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-11T08:35:01.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:01 smithi173 ceph-mon[40835]: pgmap v1179: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-09-11T08:35:03.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:03 smithi175 ceph-mon[32813]: pgmap v1180: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:03.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:03 smithi173 ceph-mon[29664]: pgmap v1180: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:03.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:03 smithi173 ceph-mon[40835]: pgmap v1180: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:05.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:06.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:05 smithi175 ceph-mon[32813]: pgmap v1181: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:06.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[29664]: pgmap v1181: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:06.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:06.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:05 smithi173 ceph-mon[40835]: pgmap v1181: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:35:07.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:07.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:07.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:07 smithi175 ceph-mon[32813]: pgmap v1182: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:07.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:07 smithi173 ceph-mon[29664]: pgmap v1182: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:07] "GET /metrics HTTP/1.1" 200 226268 "" "Prometheus/2.43.0" 2024-09-11T08:35:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:07.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:07 smithi173 ceph-mon[40835]: pgmap v1182: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:09.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:09 smithi175 ceph-mon[32813]: pgmap v1183: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:09.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:09 smithi173 ceph-mon[29664]: pgmap v1183: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:09.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:09 smithi173 ceph-mon[40835]: pgmap v1183: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:11.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:11 smithi175 ceph-mon[32813]: pgmap v1184: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:11 smithi173 ceph-mon[29664]: pgmap v1184: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:11.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:11 smithi173 ceph-mon[40835]: pgmap v1184: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:12.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:35:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:35:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:35:12.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:35:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:35:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:35:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:12.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:35:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:35:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:35:12.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:35:13.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:13 smithi175 ceph-mon[32813]: pgmap v1185: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:13 smithi173 ceph-mon[29664]: pgmap v1185: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:13.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:13 smithi173 ceph-mon[40835]: pgmap v1185: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:15.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:15.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:15 smithi175 ceph-mon[32813]: pgmap v1186: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:15 smithi173 ceph-mon[29664]: pgmap v1186: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:15.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:15 smithi173 ceph-mon[40835]: pgmap v1186: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:17.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:17.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:17.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:17 smithi173 ceph-mon[29664]: pgmap v1187: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:17.769 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:17] "GET /metrics HTTP/1.1" 200 226268 "" "Prometheus/2.43.0" 2024-09-11T08:35:17.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:17.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:17 smithi173 ceph-mon[40835]: pgmap v1187: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:17.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:17 smithi175 ceph-mon[32813]: pgmap v1187: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:19.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:19 smithi175 ceph-mon[32813]: pgmap v1188: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:19 smithi173 ceph-mon[29664]: pgmap v1188: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:19.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:19 smithi173 ceph-mon[40835]: pgmap v1188: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:20.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:20.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:21.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:21 smithi175 ceph-mon[32813]: pgmap v1189: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:21 smithi173 ceph-mon[29664]: pgmap v1189: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:21.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:21 smithi173 ceph-mon[40835]: pgmap v1189: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:22.969 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=149472 2024-09-11T08:35:22.969 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_objects 100 2024-09-11T08:35:22.969 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put onemore /etc/passwd 2024-09-11T08:35:23.058 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 -- 172.21.15.173:0/402465367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc444102030 msgr2=0x7fc4440fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/402465367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc444102030 0x7fc4440fb860 secure :-1 s=READY pgs=2930 cs=0 l=1 rev1=1 crypto rx=0x7fc42c004950 tx=0x7fc42c009da0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 -- 172.21.15.173:0/402465367 shutdown_connections 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/402465367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4440fbf90 0x7fc444108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/402465367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc444102030 0x7fc4440fb860 unknown :-1 s=CLOSED pgs=2930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/402465367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc444101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 -- 172.21.15.173:0/402465367 >> 172.21.15.173:0/402465367 conn(0x7fc444072600 msgr2=0x7fc444072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 -- 172.21.15.173:0/402465367 shutdown_connections 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.058+0000 7fc44b0e8640 1 -- 172.21.15.173:0/402465367 wait complete. 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 Processor -- start 2024-09-11T08:35:23.059 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 -- start start 2024-09-11T08:35:23.062 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc4441091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 0x7fc444109710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44411b170 con 0x7fc444102030 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44411b2e0 con 0x7fc444101720 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc44b0e8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44411b4a0 con 0x7fc4440fbf90 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc448e84640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc449685640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 0x7fc444109710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc448e84640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:50064/0 (socket says 172.21.15.173:50064) 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.059+0000 7fc448e84640 1 -- 172.21.15.173:0/1703312415 learned_addr learned my addr 172.21.15.173:0/1703312415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc443fff640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc4441091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 -- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 msgr2=0x7fc444108c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.063 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 -- 172.21.15.173:0/1703312415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 msgr2=0x7fc4441091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc4441091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0098b0 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc448e84640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc443fff640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc4441091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc449685640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 0x7fc444109710 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001da0 tx=0x7fc43c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00fdd0 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fc43c007cd0 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c005040 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0096f0 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.060+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44411ba70 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.061+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44404bf60 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.062+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fc43c007890 con 0x7fc444102030 2024-09-11T08:35:23.064 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.062+0000 7fc4417fa640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 0x7fc430071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:23.065 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.062+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(744..744 src has 1..744) v4 ==== 8972+0+0 (secure 0 0 0) 0x7fc43c08f0e0 con 0x7fc444102030 2024-09-11T08:35:23.065 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.062+0000 7fc448e84640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 0x7fc430071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:23.065 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.062+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=745}) v3 -- 0x7fc43007a6e0 con 0x7fc444102030 2024-09-11T08:35:23.065 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.063+0000 7fc448e84640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 0x7fc430071470 secure :-1 s=READY pgs=3618 cs=0 l=1 rev1=1 crypto rx=0x7fc434010540 tx=0x7fc43400b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:23.066 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.066+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc43c05b4c0 con 0x7fc444102030 2024-09-11T08:35:23.222 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.222+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fc4440fcdc0 con 0x7fc444102030 2024-09-11T08:35:23.275 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.275+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 7 ==== osd_map(745..745 src has 1..745) v4 ==== 620+0+0 (secure 0 0 0) 0x7fc43c05b200 con 0x7fc444102030 2024-09-11T08:35:23.275 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.275+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=746}) v3 -- 0x7fc43007b2b0 con 0x7fc444102030 2024-09-11T08:35:23.279 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.280+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v745) v1 ==== 225+0+0 (secure 0 0 0) 0x7fc43c01a0d0 con 0x7fc444102030 2024-09-11T08:35:23.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:23.375+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fc44410baf0 con 0x7fc444102030 2024-09-11T08:35:23.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:23 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:23 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:23.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:23 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:24.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.290+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 9 ==== osd_map(746..746 src has 1..746) v4 ==== 620+0+0 (secure 0 0 0) 0x7fc43c05e890 con 0x7fc444102030 2024-09-11T08:35:24.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.290+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=747}) v3 -- 0x7fc43007b8d0 con 0x7fc444102030 2024-09-11T08:35:24.294 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.295+0000 7fc4417fa640 1 -- 172.21.15.173:0/1703312415 <== mon.0 v2:172.21.15.173:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v746) v1 ==== 225+0+0 (secure 0 0 0) 0x7fc43c05ae60 con 0x7fc444102030 2024-09-11T08:35:24.295 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_objects = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:35:24.298 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 msgr2=0x7fc430071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:24.298 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 0x7fc430071470 secure :-1 s=READY pgs=3618 cs=0 l=1 rev1=1 crypto rx=0x7fc434010540 tx=0x7fc43400b040 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 msgr2=0x7fc444109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 0x7fc444109710 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001da0 tx=0x7fc43c004c50 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 shutdown_connections 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fc43006efc0 0x7fc430071470 unknown :-1 s=CLOSED pgs=3618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc444102030 0x7fc444109710 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc444101720 0x7fc4441091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 --2- 172.21.15.173:0/1703312415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4440fbf90 0x7fc444108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.298+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 >> 172.21.15.173:0/1703312415 conn(0x7fc444072600 msgr2=0x7fc4440ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.299+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 shutdown_connections 2024-09-11T08:35:24.299 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:24.299+0000 7fc44b0e8640 1 -- 172.21.15.173:0/1703312415 wait complete. 2024-09-11T08:35:24.309 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 149472 2024-09-11T08:35:24.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:24 smithi175 ceph-mon[32813]: osdmap e745: 8 total, 8 up, 8 in 2024-09-11T08:35:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:24 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:24.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:24 smithi175 ceph-mon[32813]: pgmap v1191: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[29664]: osdmap e745: 8 total, 8 up, 8 in 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[29664]: pgmap v1191: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[40835]: osdmap e745: 8 total, 8 up, 8 in 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]: dispatch 2024-09-11T08:35:24.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:24 smithi173 ceph-mon[40835]: pgmap v1191: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:25.251 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T08:35:25.252 INFO:tasks.workunit.client.0.smithi173.stderr:+ true 2024-09-11T08:35:25.252 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put twomore /etc/passwd 2024-09-11T08:35:25.285 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_bytes 100 2024-09-11T08:35:25.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-mon[32813]: osdmap e746: 8 total, 8 up, 8 in 2024-09-11T08:35:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-mon[32813]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:35:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-mon[32813]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:35:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:25 smithi175 ceph-mon[32813]: osdmap e747: 8 total, 8 up, 8 in 2024-09-11T08:35:25.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.365+0000 7f0c44f09640 1 -- 172.21.15.173:0/2638392037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c400fbd30 msgr2=0x7f0c401083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:25.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.365+0000 7f0c44f09640 1 --2- 172.21.15.173:0/2638392037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c400fbd30 0x7f0c401083d0 secure :-1 s=READY pgs=2933 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009cd0 tx=0x7f0c38004d10 comp rx=0 tx=0).stop 2024-09-11T08:35:25.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- 172.21.15.173:0/2638392037 shutdown_connections 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- 172.21.15.173:0/2638392037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c400fbd30 0x7f0c401083d0 unknown :-1 s=CLOSED pgs=2933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- 172.21.15.173:0/2638392037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c40101f90 0x7f0c400fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- 172.21.15.173:0/2638392037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c401015f0 0x7f0c401019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- 172.21.15.173:0/2638392037 >> 172.21.15.173:0/2638392037 conn(0x7f0c40072530 msgr2=0x7f0c400f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- 172.21.15.173:0/2638392037 shutdown_connections 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- 172.21.15.173:0/2638392037 wait complete. 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 Processor -- start 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- start start 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:25.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 0x7f0c40112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c40101f90 0x7f0c4010c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4010cf70 con 0x7f0c400fbd30 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4010d0e0 con 0x7f0c40101f90 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c44f09640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4010d2a0 con 0x7f0c401015f0 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c3e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c37fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 0x7f0c40112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c3e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38758/0 (socket says 172.21.15.173:38758) 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.366+0000 7f0c3e59c640 1 -- 172.21.15.173:0/1418548444 learned_addr learned my addr 172.21.15.173:0/1418548444 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 -- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 msgr2=0x7f0c40112cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 0x7f0c40112cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:25.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 -- 172.21.15.173:0/1418548444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c40101f90 msgr2=0x7f0c4010c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c40101f90 0x7f0c4010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30005040 con 0x7f0c400fbd30 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c37fff640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 0x7f0c40112cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c3e59c640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009780 tx=0x7f0c30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300099c0 con 0x7f0c400fbd30 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c380098b0 con 0x7f0c400fbd30 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f0c3000f040 con 0x7f0c400fbd30 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30013bf0 con 0x7f0c400fbd30 2024-09-11T08:35:25.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.367+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40119590 con 0x7f0c400fbd30 2024-09-11T08:35:25.372 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.368+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c400fcd70 con 0x7f0c400fbd30 2024-09-11T08:35:25.372 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.368+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f0c3000ebb0 con 0x7f0c400fbd30 2024-09-11T08:35:25.372 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.369+0000 7f0c36ffd640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 0x7f0c2c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:25.372 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.369+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(747..747 src has 1..747) v4 ==== 8972+0+0 (secure 0 0 0) 0x7f0c3008ef90 con 0x7f0c400fbd30 2024-09-11T08:35:25.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.369+0000 7f0c37fff640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 0x7f0c2c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:25.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.369+0000 7f0c37fff640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 0x7f0c2c071470 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 crypto rx=0x7f0c4010dc00 tx=0x7f0c28004330 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:25.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.373+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c3005b2c0 con 0x7f0c400fbd30 2024-09-11T08:35:25.528 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:25.528+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f0c4010de10 con 0x7f0c400fbd30 2024-09-11T08:35:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[29664]: osdmap e746: 8 total, 8 up, 8 in 2024-09-11T08:35:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[29664]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:35:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[29664]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:35:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[29664]: osdmap e747: 8 total, 8 up, 8 in 2024-09-11T08:35:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1703312415' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "100"}]': finished 2024-09-11T08:35:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[40835]: osdmap e746: 8 total, 8 up, 8 in 2024-09-11T08:35:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[40835]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:35:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[40835]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:35:25.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:25 smithi173 ceph-mon[40835]: osdmap e747: 8 total, 8 up, 8 in 2024-09-11T08:35:26.304 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:26.304+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v748) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0c3005ac60 con 0x7f0c400fbd30 2024-09-11T08:35:26.401 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:26.401+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f0c4010a880 con 0x7f0c400fbd30 2024-09-11T08:35:26.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:26 smithi175 ceph-mon[32813]: pgmap v1194: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:26.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:26 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:26 smithi173 ceph-mon[29664]: pgmap v1194: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:26.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:26 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:26 smithi173 ceph-mon[40835]: pgmap v1194: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:26.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:26 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:27.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:27.307 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.307+0000 7f0c36ffd640 1 -- 172.21.15.173:0/1418548444 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v749) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0c3005ae40 con 0x7f0c400fbd30 2024-09-11T08:35:27.307 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_bytes = 100 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.309+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 msgr2=0x7f0c2c071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.309+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 0x7f0c2c071470 secure :-1 s=READY pgs=3620 cs=0 l=1 rev1=1 crypto rx=0x7f0c4010dc00 tx=0x7f0c28004330 comp rx=0 tx=0).stop 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 msgr2=0x7f0c40112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009780 tx=0x7f0c30009da0 comp rx=0 tx=0).stop 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 shutdown_connections 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f0c2c06efc0 0x7f0c2c071470 unknown :-1 s=CLOSED pgs=3620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c40101f90 0x7f0c4010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c401015f0 0x7f0c40112cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:27.310 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 --2- 172.21.15.173:0/1418548444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c400fbd30 0x7f0c40112770 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:27.311 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 >> 172.21.15.173:0/1418548444 conn(0x7f0c40072530 msgr2=0x7f0c40065320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:27.311 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 shutdown_connections 2024-09-11T08:35:27.311 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:27.310+0000 7f0c44f09640 1 -- 172.21.15.173:0/1418548444 wait complete. 2024-09-11T08:35:27.322 INFO:tasks.workunit.client.0.smithi173.stderr:+ sleep 30 2024-09-11T08:35:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:27 smithi175 ceph-mon[32813]: osdmap e748: 8 total, 8 up, 8 in 2024-09-11T08:35:27.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:27 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[29664]: osdmap e748: 8 total, 8 up, 8 in 2024-09-11T08:35:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:27.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:27] "GET /metrics HTTP/1.1" 200 226228 "" "Prometheus/2.43.0" 2024-09-11T08:35:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[40835]: osdmap e748: 8 total, 8 up, 8 in 2024-09-11T08:35:27.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:27 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]: dispatch 2024-09-11T08:35:28.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:28 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:28 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:28 smithi175 ceph-mon[32813]: osdmap e749: 8 total, 8 up, 8 in 2024-09-11T08:35:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:28 smithi175 ceph-mon[32813]: pgmap v1197: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[29664]: osdmap e749: 8 total, 8 up, 8 in 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[29664]: pgmap v1197: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:28.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1418548444' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "100"}]': finished 2024-09-11T08:35:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[40835]: osdmap e749: 8 total, 8 up, 8 in 2024-09-11T08:35:28.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:28 smithi173 ceph-mon[40835]: pgmap v1197: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.5 KiB/s wr, 1 op/s 2024-09-11T08:35:29.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:29 smithi175 ceph-mon[32813]: pgmap v1198: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-09-11T08:35:29.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:29 smithi173 ceph-mon[29664]: pgmap v1198: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-09-11T08:35:29.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:29 smithi173 ceph-mon[40835]: pgmap v1198: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-09-11T08:35:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:30 smithi175 ceph-mon[32813]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_bytes: 100 B) 2024-09-11T08:35:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:30 smithi175 ceph-mon[32813]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:30.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:30 smithi175 ceph-mon[32813]: osdmap e750: 8 total, 8 up, 8 in 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[29664]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_bytes: 100 B) 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[29664]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[29664]: osdmap e750: 8 total, 8 up, 8 in 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[40835]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' is full (reached quota's max_bytes: 100 B) 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[40835]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:35:30.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:30 smithi173 ceph-mon[40835]: osdmap e750: 8 total, 8 up, 8 in 2024-09-11T08:35:31.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:31 smithi175 ceph-mon[32813]: pgmap v1200: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-11T08:35:31.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:31 smithi173 ceph-mon[29664]: pgmap v1200: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-11T08:35:31.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:31 smithi173 ceph-mon[40835]: pgmap v1200: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 1 op/s 2024-09-11T08:35:33.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:33 smithi175 ceph-mon[32813]: pgmap v1201: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-11T08:35:33.965 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:33 smithi173 ceph-mon[29664]: pgmap v1201: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-11T08:35:33.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:33 smithi173 ceph-mon[40835]: pgmap v1201: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-11T08:35:35.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:34 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:35.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:34 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:35.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:34 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:35.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:36.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:35 smithi175 ceph-mon[32813]: pgmap v1202: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 0 op/s 2024-09-11T08:35:36.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:35 smithi173 ceph-mon[29664]: pgmap v1202: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 0 op/s 2024-09-11T08:35:36.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:35 smithi173 ceph-mon[40835]: pgmap v1202: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 0 op/s 2024-09-11T08:35:37.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:37.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:37.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:37 smithi175 ceph-mon[32813]: pgmap v1203: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:37] "GET /metrics HTTP/1.1" 200 226240 "" "Prometheus/2.43.0" 2024-09-11T08:35:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:37 smithi173 ceph-mon[29664]: pgmap v1203: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:37.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:37.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:37 smithi173 ceph-mon[40835]: pgmap v1203: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:39.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:39 smithi175 ceph-mon[32813]: pgmap v1204: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:39.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:39 smithi173 ceph-mon[29664]: pgmap v1204: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:39.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:39 smithi173 ceph-mon[40835]: pgmap v1204: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:41.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:41 smithi175 ceph-mon[32813]: pgmap v1205: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:41.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:41 smithi173 ceph-mon[29664]: pgmap v1205: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:41.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:41 smithi173 ceph-mon[40835]: pgmap v1205: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-11T08:35:43.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:43 smithi175 ceph-mon[32813]: pgmap v1206: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:43.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:43 smithi173 ceph-mon[29664]: pgmap v1206: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:43.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:43 smithi173 ceph-mon[40835]: pgmap v1206: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:45.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:45 smithi175 ceph-mon[32813]: pgmap v1207: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:45 smithi173 ceph-mon[29664]: pgmap v1207: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:45.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:45 smithi173 ceph-mon[40835]: pgmap v1207: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:35:47.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:47.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:47 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:47.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:47 smithi173 ceph-mon[29664]: pgmap v1208: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:47.769 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:47] "GET /metrics HTTP/1.1" 200 226240 "" "Prometheus/2.43.0" 2024-09-11T08:35:47.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:47 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:47.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:47 smithi173 ceph-mon[40835]: pgmap v1208: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:47.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:47 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:47.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:47 smithi175 ceph-mon[32813]: pgmap v1208: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:49.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:49 smithi175 ceph-mon[32813]: pgmap v1209: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:49.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:49 smithi173 ceph-mon[29664]: pgmap v1209: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:49.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:49 smithi173 ceph-mon[40835]: pgmap v1209: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:50.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:50.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:50.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:35:51.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:51 smithi175 ceph-mon[32813]: pgmap v1210: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:51.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:51 smithi173 ceph-mon[29664]: pgmap v1210: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:51.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:51 smithi173 ceph-mon[40835]: pgmap v1210: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:53.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:53 smithi175 ceph-mon[32813]: pgmap v1211: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:53.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:53 smithi173 ceph-mon[29664]: pgmap v1211: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:53.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:53 smithi173 ceph-mon[40835]: pgmap v1211: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:55.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:35:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:35:55.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:55 smithi175 ceph-mon[32813]: pgmap v1212: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:55.965 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:55 smithi173 ceph-mon[29664]: pgmap v1212: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:55.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:55 smithi173 ceph-mon[40835]: pgmap v1212: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-11T08:35:57.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:35:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:35:57.323 INFO:tasks.workunit.client.0.smithi173.stderr:+ pid=149562 2024-09-11T08:35:57.324 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_bytes 0 2024-09-11T08:35:57.324 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put two /etc/passwd 2024-09-11T08:35:57.415 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 -- 172.21.15.173:0/2046155302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 msgr2=0x7fcfa40fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:57.415 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 --2- 172.21.15.173:0/2046155302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa40fcbb0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c004980 tx=0x7fcf8c009da0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.415 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 -- 172.21.15.173:0/2046155302 shutdown_connections 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 --2- 172.21.15.173:0/2046155302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa40fd0f0 0x7fcfa4109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 --2- 172.21.15.173:0/2046155302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa40fcbb0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 --2- 172.21.15.173:0/2046155302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa4102760 0x7fcfa4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 -- 172.21.15.173:0/2046155302 >> 172.21.15.173:0/2046155302 conn(0x7fcfa40f82c0 msgr2=0x7fcfa40fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 -- 172.21.15.173:0/2046155302 shutdown_connections 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 -- 172.21.15.173:0/2046155302 wait complete. 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.413+0000 7fcfa9657640 1 Processor -- start 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 -- start start 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:57.416 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 0x7fcfa4112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 0x7fcfa410cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa410d1e0 con 0x7fcfa40fc740 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa410d350 con 0x7fcfa40fd0f0 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa9657640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa410d510 con 0x7fcfa4102760 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 0x7fcfa410cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36242/0 (socket says 172.21.15.173:36242) 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa2ffd640 1 -- 172.21.15.173:0/4068849485 learned_addr learned my addr 172.21.15.173:0/4068849485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcf9a7fc640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 0x7fcfa4112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 -- 172.21.15.173:0/4068849485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 msgr2=0x7fcfa4112f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 0x7fcfa4112f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.417 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 -- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 msgr2=0x7fcfa4112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa37fe640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0098b0 con 0x7fcfa4102760 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcf9a7fc640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 0x7fcfa4112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.414+0000 7fcfa2ffd640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcfa37fe640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 0x7fcfa410cb90 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c001da0 tx=0x7fcf9c004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00fdd0 con 0x7fcfa4102760 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fcf9c007cd0 con 0x7fcfa4102760 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf94005040 con 0x7fcfa4102760 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c009610 con 0x7fcfa4102760 2024-09-11T08:35:57.418 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.415+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c005040 con 0x7fcfa4102760 2024-09-11T08:35:57.419 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.416+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40fde80 con 0x7fcfa4102760 2024-09-11T08:35:57.419 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.416+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fcf9c007890 con 0x7fcfa4102760 2024-09-11T08:35:57.419 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.417+0000 7fcf9bfff640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 0x7fcf90071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:57.419 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.417+0000 7fcfa2ffd640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 0x7fcf90071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:57.419 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.417+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(750..750 src has 1..750) v4 ==== 8972+0+0 (secure 0 0 0) 0x7fcf9c08ef40 con 0x7fcfa4102760 2024-09-11T08:35:57.420 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.417+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=751}) v3 -- 0x7fcf9007a6e0 con 0x7fcfa4102760 2024-09-11T08:35:57.420 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.417+0000 7fcfa2ffd640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 0x7fcf90071470 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 crypto rx=0x7fcf94004f40 tx=0x7fcf9400b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:57.421 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.421+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcf9c05b320 con 0x7fcfa4102760 2024-09-11T08:35:57.582 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:57.582+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcfa410b940 con 0x7fcfa4102760 2024-09-11T08:35:57.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:57.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:57 smithi175 ceph-mon[32813]: pgmap v1213: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:57.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:35:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:35:57] "GET /metrics HTTP/1.1" 200 226228 "" "Prometheus/2.43.0" 2024-09-11T08:35:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:57.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:57 smithi173 ceph-mon[29664]: pgmap v1213: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:57.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:35:57.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:57 smithi173 ceph-mon[40835]: pgmap v1213: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:35:58.500 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:58.500+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 7 ==== osd_map(751..751 src has 1..751) v4 ==== 620+0+0 (secure 0 0 0) 0x7fcf9c05b060 con 0x7fcfa4102760 2024-09-11T08:35:58.500 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:58.500+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=752}) v3 -- 0x7fcf9007b2b0 con 0x7fcfa4102760 2024-09-11T08:35:58.504 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:58.504+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v751) v1 ==== 217+0+0 (secure 0 0 0) 0x7fcf9c01a020 con 0x7fcfa4102760 2024-09-11T08:35:58.603 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:58.603+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcfa410e070 con 0x7fcfa4102760 2024-09-11T08:35:58.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:58 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:58.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:58 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:58 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:58.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:58 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:58.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:58 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:58.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:58 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.514+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 9 ==== osd_map(752..752 src has 1..752) v4 ==== 620+0+0 (secure 0 0 0) 0x7fcf9c05e6f0 con 0x7fcfa4102760 2024-09-11T08:35:59.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.514+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=753}) v3 -- 0x7fcf9007b910 con 0x7fcfa4102760 2024-09-11T08:35:59.519 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.520+0000 7fcf9bfff640 1 -- 172.21.15.173:0/4068849485 <== mon.2 v2:172.21.15.173:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v752) v1 ==== 217+0+0 (secure 0 0 0) 0x7fcf9c05acc0 con 0x7fcfa4102760 2024-09-11T08:35:59.520 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 msgr2=0x7fcf90071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 0x7fcf90071470 secure :-1 s=READY pgs=3622 cs=0 l=1 rev1=1 crypto rx=0x7fcf94004f40 tx=0x7fcf9400b040 comp rx=0 tx=0).stop 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 msgr2=0x7fcfa410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 0x7fcfa410cb90 secure :-1 s=READY pgs=2937 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c001da0 tx=0x7fcf9c004c50 comp rx=0 tx=0).stop 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 shutdown_connections 2024-09-11T08:35:59.523 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fcf9006efc0 0x7fcf90071470 unknown :-1 s=CLOSED pgs=3622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfa4102760 0x7fcfa410cb90 unknown :-1 s=CLOSED pgs=2937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfa40fd0f0 0x7fcfa4112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 --2- 172.21.15.173:0/4068849485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfa40fc740 0x7fcfa4112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 >> 172.21.15.173:0/4068849485 conn(0x7fcfa40f82c0 msgr2=0x7fcfa4100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 shutdown_connections 2024-09-11T08:35:59.524 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.523+0000 7fcfa9657640 1 -- 172.21.15.173:0/4068849485 wait complete. 2024-09-11T08:35:59.533 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_objects 0 2024-09-11T08:35:59.614 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 -- 172.21.15.173:0/231648591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 msgr2=0x7f9c04106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:59.614 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 --2- 172.21.15.173:0/231648591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04106740 secure :-1 s=READY pgs=2938 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8004950 tx=0x7f9bf8009da0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.614 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 -- 172.21.15.173:0/231648591 shutdown_connections 2024-09-11T08:35:59.614 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 --2- 172.21.15.173:0/231648591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c041090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.614 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 --2- 172.21.15.173:0/231648591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04106740 unknown :-1 s=CLOSED pgs=2938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 --2- 172.21.15.173:0/231648591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c040fd760 0x7f9c040fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 -- 172.21.15.173:0/231648591 >> 172.21.15.173:0/231648591 conn(0x7f9c04072530 msgr2=0x7f9c040f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 -- 172.21.15.173:0/231648591 shutdown_connections 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.611+0000 7f9c0931d640 1 -- 172.21.15.173:0/231648591 wait complete. 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 Processor -- start 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 -- start start 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c040fd760 0x7f9c04112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c0410cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0410d270 con 0x7f9c04106d10 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0410d3e0 con 0x7f9c040fd760 2024-09-11T08:35:59.615 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c0931d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0410d5a0 con 0x7f9c040fe100 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c037fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c0410cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:46966/0 (socket says 172.21.15.173:46966) 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 -- 172.21.15.173:0/3709498470 learned_addr learned my addr 172.21.15.173:0/3709498470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 -- 172.21.15.173:0/3709498470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c040fd760 msgr2=0x7f9c04112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c040fd760 0x7f9c04112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 -- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 msgr2=0x7f9c0410cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.612+0000 7f9c027fc640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c0410cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9c027fc640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc005040 con 0x7f9c040fe100 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9c037fe640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c0410cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:35:59.616 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9c027fc640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009040 tx=0x7f9bf8035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8009530 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f9bf8033860 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf8005040 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf803c620 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.613+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04119890 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.614+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c04065330 con 0x7f9c040fe100 2024-09-11T08:35:59.617 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.614+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f9bf8030020 con 0x7f9c040fe100 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.615+0000 7f9beb7fe640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 0x7f9bec071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.615+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(752..752 src has 1..752) v4 ==== 8972+0+0 (secure 0 0 0) 0x7f9bf80aec10 con 0x7f9c040fe100 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.615+0000 7f9c02ffd640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 0x7f9bec071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.615+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=753}) v3 -- 0x7f9bec07a6e0 con 0x7f9c040fe100 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.615+0000 7f9c02ffd640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 0x7f9bec071470 secure :-1 s=READY pgs=3623 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4007fd0 tx=0x7f9bf4007b20 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:35:59.618 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.619+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9bf807b080 con 0x7f9c040fe100 2024-09-11T08:35:59.772 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:35:59.773+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f9c0410b920 con 0x7f9c040fe100 2024-09-11T08:35:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:35:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:59 smithi175 ceph-mon[32813]: osdmap e751: 8 total, 8 up, 8 in 2024-09-11T08:35:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:59 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:59 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:35:59 smithi175 ceph-mon[32813]: pgmap v1215: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[29664]: osdmap e751: 8 total, 8 up, 8 in 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[29664]: pgmap v1215: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[40835]: osdmap e751: 8 total, 8 up, 8 in 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4068849485' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:35:59.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:35:59 smithi173 ceph-mon[40835]: pgmap v1215: 176 pgs: 176 active+clean; 732 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:00.242 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:00.242+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 7 ==== osd_map(753..753 src has 1..753) v4 ==== 620+0+0 (secure 0 0 0) 0x7f9bf80339d0 con 0x7f9c040fe100 2024-09-11T08:36:00.242 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:00.242+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=754}) v3 -- 0x7f9bec07b2b0 con 0x7f9c040fe100 2024-09-11T08:36:00.248 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:00.248+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v753) v1 ==== 221+0+0 (secure 0 0 0) 0x7f9bf807aa20 con 0x7f9c040fe100 2024-09-11T08:36:00.341 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:00.341+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f9c0404bf60 con 0x7f9c040fe100 2024-09-11T08:36:00.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: osdmap e752: 8 total, 8 up, 8 in 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: osdmap e753: 8 total, 8 up, 8 in 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:00 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: osdmap e752: 8 total, 8 up, 8 in 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: osdmap e753: 8 total, 8 up, 8 in 2024-09-11T08:36:00.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: osdmap e752: 8 total, 8 up, 8 in 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' no longer out of quota; removing NO_QUOTA flag 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: osdmap e753: 8 total, 8 up, 8 in 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3709498470' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:00.967 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:00 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:36:01.245 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.245+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 9 ==== osd_map(754..754 src has 1..754) v4 ==== 620+0+0 (secure 0 0 0) 0x7f9bf807adc0 con 0x7f9c040fe100 2024-09-11T08:36:01.249 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.249+0000 7f9beb7fe640 1 -- 172.21.15.173:0/3709498470 <== mon.2 v2:172.21.15.173:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v754) v1 ==== 221+0+0 (secure 0 0 0) 0x7f9bf80b1020 con 0x7f9c040fe100 2024-09-11T08:36:01.249 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:36:01.252 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 msgr2=0x7f9bec071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 0x7f9bec071470 secure :-1 s=READY pgs=3623 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4007fd0 tx=0x7f9bf4007b20 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 msgr2=0x7f9c04112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009040 tx=0x7f9bf8035040 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 shutdown_connections 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9bec06efc0 0x7f9bec071470 unknown :-1 s=CLOSED pgs=3623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c04106d10 0x7f9c0410cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c040fe100 0x7f9c04112f80 unknown :-1 s=CLOSED pgs=2939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 --2- 172.21.15.173:0/3709498470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c040fd760 0x7f9c04112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 >> 172.21.15.173:0/3709498470 conn(0x7f9c04072530 msgr2=0x7f9c040fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 shutdown_connections 2024-09-11T08:36:01.253 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.252+0000 7f9c0931d640 1 -- 172.21.15.173:0/3709498470 wait complete. 2024-09-11T08:36:01.262 INFO:tasks.workunit.client.0.smithi173.stderr:+ wait 149562 2024-09-11T08:36:01.262 INFO:tasks.workunit.client.0.smithi173.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T08:36:01.262 INFO:tasks.workunit.client.0.smithi173.stderr:+ true 2024-09-11T08:36:01.262 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put three /etc/passwd 2024-09-11T08:36:01.294 INFO:tasks.workunit.client.0.smithi173.stderr:++ uuidgen 2024-09-11T08:36:01.295 INFO:tasks.workunit.client.0.smithi173.stderr:+ pp=81eb9a0c-cdba-4538-b88a-81daa6fd2327 2024-09-11T08:36:01.295 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool create 81eb9a0c-cdba-4538-b88a-81daa6fd2327 12 2024-09-11T08:36:01.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 -- 172.21.15.173:0/1136347119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f100fb2b0 msgr2=0x7f4f10109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:01.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 --2- 172.21.15.173:0/1136347119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f100fb2b0 0x7f4f10109480 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f4f08004950 tx=0x7f4f08009da0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 -- 172.21.15.173:0/1136347119 shutdown_connections 2024-09-11T08:36:01.373 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 --2- 172.21.15.173:0/1136347119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f100fb2b0 0x7f4f10109480 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 --2- 172.21.15.173:0/1136347119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f10103020 0x7f4f100fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 --2- 172.21.15.173:0/1136347119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 0x7f4f10102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 -- 172.21.15.173:0/1136347119 >> 172.21.15.173:0/1136347119 conn(0x7f4f10074b90 msgr2=0x7f4f100f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 -- 172.21.15.173:0/1136347119 shutdown_connections 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.371+0000 7f4f1571d640 1 -- 172.21.15.173:0/1136347119 wait complete. 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 Processor -- start 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 -- start start 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 0x7f4f10112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1010cf60 con 0x7f4f10103020 2024-09-11T08:36:01.374 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1010d0d0 con 0x7f4f10102680 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f1571d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1010d290 con 0x7f4f100fb2b0 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0effd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36296/0 (socket says 172.21.15.173:36296) 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0effd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:47020/0 (socket says 172.21.15.173:47020) 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0f7fe640 1 -- 172.21.15.173:0/3100452788 learned_addr learned my addr 172.21.15.173:0/3100452788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.372+0000 7f4f0e7fc640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 0x7f4f10112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 -- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 msgr2=0x7f4f10112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 -- 172.21.15.173:0/3100452788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 msgr2=0x7f4f10112ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 0x7f4f10112ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005040 con 0x7f4f10103020 2024-09-11T08:36:01.375 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0effd640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f0f7fe640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f4f0802d040 tx=0x7f4f08035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08033420 con 0x7f4f10103020 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f4f080339c0 con 0x7f4f10103020 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08005040 con 0x7f4f10103020 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0803c680 con 0x7f4f10103020 2024-09-11T08:36:01.376 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.373+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f10119580 con 0x7f4f10103020 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.374+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f100fdea0 con 0x7f4f10103020 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.374+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f4f08030020 con 0x7f4f10103020 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.375+0000 7f4f077fe640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 0x7f4efc0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.375+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(754..754 src has 1..754) v4 ==== 8972+0+0 (secure 0 0 0) 0x7f4f080aee10 con 0x7f4f10103020 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.375+0000 7f4f0effd640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 0x7f4efc0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:01.377 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.375+0000 7f4f0effd640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 0x7f4efc0713b0 secure :-1 s=READY pgs=3625 cs=0 l=1 rev1=1 crypto rx=0x7f4f00004550 tx=0x7f4f00009040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:01.379 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.379+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4f0807b270 con 0x7f4f10103020 2024-09-11T08:36:01.533 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:01.533+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12} v 0) v1 -- 0x7f4f1010ddd0 con 0x7f4f10103020 2024-09-11T08:36:02.260 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.260+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]=0 pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' created v755) v1 ==== 176+0+0 (secure 0 0 0) 0x7f4f0807ac10 con 0x7f4f10103020 2024-09-11T08:36:02.356 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.356+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12} v 0) v1 -- 0x7f4f1004bf60 con 0x7f4f10103020 2024-09-11T08:36:02.356 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.356+0000 7f4f077fe640 1 -- 172.21.15.173:0/3100452788 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]=0 pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' already exists v755) v1 ==== 183+0+0 (secure 0 0 0) 0x7f4f0807adf0 con 0x7f4f10103020 2024-09-11T08:36:02.356 INFO:tasks.workunit.client.0.smithi173.stderr:pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' already exists 2024-09-11T08:36:02.358 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 msgr2=0x7f4efc0713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 0x7f4efc0713b0 secure :-1 s=READY pgs=3625 cs=0 l=1 rev1=1 crypto rx=0x7f4f00004550 tx=0x7f4f00009040 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 msgr2=0x7f4f1010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f4f0802d040 tx=0x7f4f08035040 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 shutdown_connections 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f4efc06ef00 0x7f4efc0713b0 unknown :-1 s=CLOSED pgs=3625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f10103020 0x7f4f1010c910 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f10102680 0x7f4f10112ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 --2- 172.21.15.173:0/3100452788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f100fb2b0 0x7f4f10112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.358+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 >> 172.21.15.173:0/3100452788 conn(0x7f4f10074b90 msgr2=0x7f4f10071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.359+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 shutdown_connections 2024-09-11T08:36:02.359 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.359+0000 7f4f1571d640 1 -- 172.21.15.173:0/3100452788 wait complete. 2024-09-11T08:36:02.367 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool application enable 81eb9a0c-cdba-4538-b88a-81daa6fd2327 rados 2024-09-11T08:36:02.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 -- 172.21.15.173:0/3769619616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274102030 msgr2=0x7fb2740fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:02.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/3769619616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274102030 0x7fb2740fb860 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7fb268004950 tx=0x7fb268009da0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 -- 172.21.15.173:0/3769619616 shutdown_connections 2024-09-11T08:36:02.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/3769619616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/3769619616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274102030 0x7fb2740fb860 unknown :-1 s=CLOSED pgs=2942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/3769619616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274101720 0x7fb274101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 -- 172.21.15.173:0/3769619616 >> 172.21.15.173:0/3769619616 conn(0x7fb274072600 msgr2=0x7fb274072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 -- 172.21.15.173:0/3769619616 shutdown_connections 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.446+0000 7fb27aa4f640 1 -- 172.21.15.173:0/3769619616 wait complete. 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 Processor -- start 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 -- start start 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274102030 0x7fb27410cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:02.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27410d2d0 con 0x7fb2740fbf90 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27410d440 con 0x7fb274102030 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb27aa4f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27410d600 con 0x7fb274101720 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb273fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:45432/0 (socket says 172.21.15.173:45432) 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 -- 172.21.15.173:0/2504647979 learned_addr learned my addr 172.21.15.173:0/2504647979 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb273fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274112af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49930/0 (socket says 172.21.15.173:49930) 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb278fec640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274102030 0x7fb27410cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 -- 172.21.15.173:0/2504647979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274102030 msgr2=0x7fb27410cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274102030 0x7fb27410cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 -- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 msgr2=0x7fb274112af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274112af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:02.450 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0098b0 con 0x7fb274101720 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.447+0000 7fb2737fe640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 crypto rx=0x7fb268009040 tx=0x7fb268009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.448+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680092e0 con 0x7fb274101720 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.448+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb268005040 con 0x7fb274101720 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.448+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7fb26803c880 con 0x7fb274101720 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.448+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268033650 con 0x7fb274101720 2024-09-11T08:36:02.451 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.448+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb274119940 con 0x7fb274101720 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.449+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27404bf60 con 0x7fb274101720 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.449+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7fb268030020 con 0x7fb274101720 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.449+0000 7fb270ff9640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 0x7fb25c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.450+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(755..755 src has 1..755) v4 ==== 9347+0+0 (secure 0 0 0) 0x7fb2680aee10 con 0x7fb274101720 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.450+0000 7fb273fff640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 0x7fb25c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:02.452 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.450+0000 7fb273fff640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 0x7fb25c071470 secure :-1 s=READY pgs=3626 cs=0 l=1 rev1=1 crypto rx=0x7fb2740fc890 tx=0x7fb26400b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:02.453 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.453+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb26807b100 con 0x7fb274101720 2024-09-11T08:36:02.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:02 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:02 smithi175 ceph-mon[32813]: osdmap e754: 8 total, 8 up, 8 in 2024-09-11T08:36:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:02 smithi175 ceph-mon[32813]: pgmap v1219: 176 pgs: 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:36:02.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:02 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:02.610 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:02.610+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"} v 0) v1 -- 0x7fb27410bad0 con 0x7fb274101720 2024-09-11T08:36:02.715 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[29664]: osdmap e754: 8 total, 8 up, 8 in 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[29664]: pgmap v1219: 176 pgs: 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[40835]: osdmap e754: 8 total, 8 up, 8 in 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[40835]: pgmap v1219: 176 pgs: 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:36:02.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:02 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:03.259 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:03.259+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]=0 enabled application 'rados' on pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' v756) v1 ==== 213+0+0 (secure 0 0 0) 0x7fb26807aaa0 con 0x7fb274101720 2024-09-11T08:36:03.361 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:03.361+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"} v 0) v1 -- 0x7fb27410e160 con 0x7fb274101720 2024-09-11T08:36:03.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]': finished 2024-09-11T08:36:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:03 smithi175 ceph-mon[32813]: osdmap e755: 8 total, 8 up, 8 in 2024-09-11T08:36:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:03 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:03.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:03 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]': finished 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[29664]: osdmap e755: 8 total, 8 up, 8 in 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]': finished 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[40835]: osdmap e755: 8 total, 8 up, 8 in 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/3100452788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pg_num": 12}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:03.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:03 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.270 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.270+0000 7fb270ff9640 1 -- 172.21.15.173:0/2504647979 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]=0 enabled application 'rados' on pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' v757) v1 ==== 213+0+0 (secure 0 0 0) 0x7fb26807ac80 con 0x7fb274101720 2024-09-11T08:36:04.270 INFO:tasks.workunit.client.0.smithi173.stderr:enabled application 'rados' on pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.272+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 msgr2=0x7fb25c071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.272+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 0x7fb25c071470 secure :-1 s=READY pgs=3626 cs=0 l=1 rev1=1 crypto rx=0x7fb2740fc890 tx=0x7fb26400b040 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.272+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 msgr2=0x7fb274113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.272+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 crypto rx=0x7fb268009040 tx=0x7fb268009da0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 shutdown_connections 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7fb25c06efc0 0x7fb25c071470 unknown :-1 s=CLOSED pgs=3626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb274102030 0x7fb27410cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb274101720 0x7fb274113030 unknown :-1 s=CLOSED pgs=2943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 --2- 172.21.15.173:0/2504647979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2740fbf90 0x7fb274112af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 >> 172.21.15.173:0/2504647979 conn(0x7fb274072600 msgr2=0x7fb2740ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 shutdown_connections 2024-09-11T08:36:04.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.273+0000 7fb27aa4f640 1 -- 172.21.15.173:0/2504647979 wait complete. 2024-09-11T08:36:04.283 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 81eb9a0c-cdba-4538-b88a-81daa6fd2327 max_objects 10 2024-09-11T08:36:04.367 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- 172.21.15.173:0/4258281513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 msgr2=0x7f3c0c1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:04.367 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- 172.21.15.173:0/4258281513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c1019c0 secure :-1 s=READY pgs=2944 cs=0 l=1 rev1=1 crypto rx=0x7f3c08004950 tx=0x7f3c08009da0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.367 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- 172.21.15.173:0/4258281513 shutdown_connections 2024-09-11T08:36:04.367 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- 172.21.15.173:0/4258281513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c1083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- 172.21.15.173:0/4258281513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c101f90 0x7f3c0c0fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- 172.21.15.173:0/4258281513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c1019c0 unknown :-1 s=CLOSED pgs=2944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- 172.21.15.173:0/4258281513 >> 172.21.15.173:0/4258281513 conn(0x7f3c0c072530 msgr2=0x7f3c0c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- 172.21.15.173:0/4258281513 shutdown_connections 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- 172.21.15.173:0/4258281513 wait complete. 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 Processor -- start 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- start start 2024-09-11T08:36:04.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c110da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 0x7f3c0c10bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c10c1a0 con 0x7f3c0c0fbd30 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c10c310 con 0x7f3c0c101f90 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.365+0000 7f3c134dd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c10c4d0 con 0x7f3c0c1015f0 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11279640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c110da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11279640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49948/0 (socket says 172.21.15.173:49948) 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11279640 1 -- 172.21.15.173:0/630154903 learned_addr learned my addr 172.21.15.173:0/630154903 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11a7a640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 0x7f3c0c10bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 -- 172.21.15.173:0/630154903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 msgr2=0x7f3c0c10bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:04.369 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 0x7f3c0c10bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 -- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 msgr2=0x7f3c0c110860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc005040 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11a7a640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 0x7f3c0c10bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c11279640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c10a78640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c110da0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0fcac0 tx=0x7f3bfc009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc009990 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f3bfc00f040 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c08005040 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc013a10 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.366+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c1187c0 con 0x7f3c0c1015f0 2024-09-11T08:36:04.370 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.367+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c0fcd70 con 0x7f3c0c1015f0 2024-09-11T08:36:04.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.368+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f3bfc00e8d0 con 0x7f3c0c1015f0 2024-09-11T08:36:04.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.368+0000 7f3c01ffb640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 0x7f3bf8071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:36:04.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.368+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(757..757 src has 1..757) v4 ==== 9360+0+0 (secure 0 0 0) 0x7f3bfc08ef00 con 0x7f3c0c1015f0 2024-09-11T08:36:04.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.368+0000 7f3c11279640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 0x7f3bf8071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:36:04.371 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.369+0000 7f3c11279640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 0x7f3bf8071470 secure :-1 s=READY pgs=3627 cs=0 l=1 rev1=1 crypto rx=0x7f3c08004540 tx=0x7f3c08035040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:36:04.372 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.372+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3bfc05b130 con 0x7f3c0c1015f0 2024-09-11T08:36:04.531 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:04.531+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f3c0c10cfc0 con 0x7f3c0c1015f0 2024-09-11T08:36:04.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:04 smithi175 ceph-mon[32813]: osdmap e756: 8 total, 8 up, 8 in 2024-09-11T08:36:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:04 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:04 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:04 smithi175 ceph-mon[32813]: pgmap v1222: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[29664]: osdmap e756: 8 total, 8 up, 8 in 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[29664]: pgmap v1222: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:04.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[40835]: osdmap e756: 8 total, 8 up, 8 in 2024-09-11T08:36:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/2504647979' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]: dispatch 2024-09-11T08:36:04.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:04 smithi173 ceph-mon[40835]: pgmap v1222: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 3.3 KiB/s wr, 1 op/s 2024-09-11T08:36:05.273 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:05.273+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 81eb9a0c-cdba-4538-b88a-81daa6fd2327 v758) v1 ==== 223+0+0 (secure 0 0 0) 0x7f3bfc05aad0 con 0x7f3c0c1015f0 2024-09-11T08:36:05.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: osdmap e757: 8 total, 8 up, 8 in 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:05.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:05 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:05.368 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:05.369+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f3c0c10a860 con 0x7f3c0c1015f0 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: osdmap e757: 8 total, 8 up, 8 in 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:05.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "app": "rados"}]': finished 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: osdmap e757: 8 total, 8 up, 8 in 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:05.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:05 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:06.286 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.286+0000 7f3c01ffb640 1 -- 172.21.15.173:0/630154903 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 81eb9a0c-cdba-4538-b88a-81daa6fd2327 v759) v1 ==== 223+0+0 (secure 0 0 0) 0x7f3bfc05acb0 con 0x7f3c0c1015f0 2024-09-11T08:36:06.286 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_objects = 10 for pool 81eb9a0c-cdba-4538-b88a-81daa6fd2327 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 msgr2=0x7f3bf8071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 0x7f3bf8071470 secure :-1 s=READY pgs=3627 cs=0 l=1 rev1=1 crypto rx=0x7f3c08004540 tx=0x7f3c08035040 comp rx=0 tx=0).stop 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 msgr2=0x7f3c0c110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c110da0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0fcac0 tx=0x7f3bfc009da0 comp rx=0 tx=0).stop 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 shutdown_connections 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f3bf806efc0 0x7f3bf8071470 unknown :-1 s=CLOSED pgs=3627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c101f90 0x7f3c0c10bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:06.289 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c0c1015f0 0x7f3c0c110da0 unknown :-1 s=CLOSED pgs=2945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:06.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 --2- 172.21.15.173:0/630154903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0c0fbd30 0x7f3c0c110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:36:06.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 >> 172.21.15.173:0/630154903 conn(0x7f3c0c072530 msgr2=0x7f3c0c0ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:36:06.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 shutdown_connections 2024-09-11T08:36:06.290 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:36:06.289+0000 7f3c134dd640 1 -- 172.21.15.173:0/630154903 wait complete. 2024-09-11T08:36:06.299 INFO:tasks.workunit.client.0.smithi173.stderr:+ sleep 30 2024-09-11T08:36:06.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-mon[32813]: osdmap e758: 8 total, 8 up, 8 in 2024-09-11T08:36:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-mon[32813]: pgmap v1225: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:36:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[29664]: osdmap e758: 8 total, 8 up, 8 in 2024-09-11T08:36:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[29664]: pgmap v1225: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:36:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[40835]: osdmap e758: 8 total, 8 up, 8 in 2024-09-11T08:36:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/630154903' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]: dispatch 2024-09-11T08:36:06.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:06 smithi173 ceph-mon[40835]: pgmap v1225: 188 pgs: 12 unknown, 176 active+clean; 744 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-09-11T08:36:07.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:07.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:07.537 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:07 smithi173 ceph-mon[29664]: osdmap e759: 8 total, 8 up, 8 in 2024-09-11T08:36:07.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:07.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:07 smithi173 ceph-mon[40835]: osdmap e759: 8 total, 8 up, 8 in 2024-09-11T08:36:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "field": "max_objects", "val": "10"}]': finished 2024-09-11T08:36:07.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:07 smithi175 ceph-mon[32813]: osdmap e759: 8 total, 8 up, 8 in 2024-09-11T08:36:07.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:07] "GET /metrics HTTP/1.1" 200 228634 "" "Prometheus/2.43.0" 2024-09-11T08:36:08.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:08 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:08.596 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:08 smithi175 ceph-mon[32813]: pgmap v1227: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-09-11T08:36:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:08 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:08.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:08 smithi173 ceph-mon[29664]: pgmap v1227: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-09-11T08:36:08.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:08 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:08.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:08 smithi173 ceph-mon[40835]: pgmap v1227: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.1 KiB/s wr, 1 op/s 2024-09-11T08:36:09.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:09 smithi175 ceph-mon[32813]: pgmap v1228: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-11T08:36:09.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:09 smithi173 ceph-mon[29664]: pgmap v1228: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-11T08:36:09.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:09 smithi173 ceph-mon[40835]: pgmap v1228: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-09-11T08:36:11.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:11 smithi175 ceph-mon[32813]: pgmap v1229: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-09-11T08:36:11.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:11 smithi173 ceph-mon[29664]: pgmap v1229: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-09-11T08:36:11.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:11 smithi173 ceph-mon[40835]: pgmap v1229: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-09-11T08:36:12.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:12 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:36:12.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:12 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:36:12.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:12 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:36:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:36:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:36:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:13.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:13 smithi175 ceph-mon[32813]: pgmap v1230: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[29664]: pgmap v1230: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:13.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:13 smithi173 ceph-mon[40835]: pgmap v1230: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:36:15.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:15.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:15 smithi175 ceph-mon[32813]: pgmap v1231: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-09-11T08:36:15.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:15 smithi173 ceph-mon[29664]: pgmap v1231: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-09-11T08:36:15.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:15 smithi173 ceph-mon[40835]: pgmap v1231: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-09-11T08:36:17.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:17.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:17 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:17.768 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:17 smithi173 ceph-mon[29664]: pgmap v1232: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-09-11T08:36:17.769 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:17] "GET /metrics HTTP/1.1" 200 228634 "" "Prometheus/2.43.0" 2024-09-11T08:36:17.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:17 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:17.769 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:17 smithi173 ceph-mon[40835]: pgmap v1232: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-09-11T08:36:17.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:17 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:17.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:17 smithi175 ceph-mon[32813]: pgmap v1232: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-09-11T08:36:19.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:19 smithi175 ceph-mon[32813]: pgmap v1233: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:19.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:19 smithi173 ceph-mon[29664]: pgmap v1233: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:19.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:19 smithi173 ceph-mon[40835]: pgmap v1233: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:20.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:20.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:20.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:21.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:21 smithi175 ceph-mon[32813]: pgmap v1234: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:21.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:21 smithi173 ceph-mon[29664]: pgmap v1234: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:21.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:21 smithi173 ceph-mon[40835]: pgmap v1234: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:24.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:24 smithi175 ceph-mon[32813]: pgmap v1235: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:24.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:24 smithi173 ceph-mon[29664]: pgmap v1235: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:24.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:24 smithi173 ceph-mon[40835]: pgmap v1235: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:25.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:26.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:26.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:26 smithi175 ceph-mon[32813]: pgmap v1236: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:26.965 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:26 smithi173 ceph-mon[29664]: pgmap v1236: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:26.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:26 smithi173 ceph-mon[40835]: pgmap v1236: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:27.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:27 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:27.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:27 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:27.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:27] "GET /metrics HTTP/1.1" 200 228687 "" "Prometheus/2.43.0" 2024-09-11T08:36:27.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:27 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:28.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:28 smithi175 ceph-mon[32813]: pgmap v1237: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:28.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:28 smithi173 ceph-mon[29664]: pgmap v1237: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:28.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:28 smithi173 ceph-mon[40835]: pgmap v1237: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:30.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:30 smithi175 ceph-mon[32813]: pgmap v1238: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:30.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:30 smithi173 ceph-mon[29664]: pgmap v1238: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:30.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:30 smithi173 ceph-mon[40835]: pgmap v1238: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:32.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:32 smithi175 ceph-mon[32813]: pgmap v1239: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:32.968 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:32 smithi173 ceph-mon[29664]: pgmap v1239: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:32.969 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:32 smithi173 ceph-mon[40835]: pgmap v1239: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:34.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:34 smithi175 ceph-mon[32813]: pgmap v1240: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:34.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:34 smithi173 ceph-mon[29664]: pgmap v1240: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:34.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:34 smithi173 ceph-mon[40835]: pgmap v1240: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:35.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:35.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:35.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:35.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:36.301 INFO:tasks.workunit.client.0.smithi173.stderr:++ seq 1 10 2024-09-11T08:36:36.302 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.302 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj1 /etc/passwd 2024-09-11T08:36:36.338 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.338 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj2 /etc/passwd 2024-09-11T08:36:36.372 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.372 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj3 /etc/passwd 2024-09-11T08:36:36.404 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.405 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj4 /etc/passwd 2024-09-11T08:36:36.436 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.436 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj5 /etc/passwd 2024-09-11T08:36:36.468 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.468 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj6 /etc/passwd 2024-09-11T08:36:36.499 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.499 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj7 /etc/passwd 2024-09-11T08:36:36.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.531 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj8 /etc/passwd 2024-09-11T08:36:36.562 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.562 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj9 /etc/passwd 2024-09-11T08:36:36.593 INFO:tasks.workunit.client.0.smithi173.stderr:+ for f in `seq 1 10` 2024-09-11T08:36:36.593 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 81eb9a0c-cdba-4538-b88a-81daa6fd2327 put obj10 /etc/passwd 2024-09-11T08:36:36.623 INFO:tasks.workunit.client.0.smithi173.stderr:+ sleep 30 2024-09-11T08:36:36.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:36 smithi175 ceph-mon[32813]: pgmap v1241: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:36.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:36.965 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:36 smithi173 ceph-mon[29664]: pgmap v1241: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:36.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:36 smithi173 ceph-mon[40835]: pgmap v1241: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:37.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:37 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:37.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:37 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:37.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:37] "GET /metrics HTTP/1.1" 200 228653 "" "Prometheus/2.43.0" 2024-09-11T08:36:37.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:37 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:38.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:38 smithi175 ceph-mon[32813]: pgmap v1242: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:38.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:38 smithi173 ceph-mon[29664]: pgmap v1242: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:38.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:38 smithi173 ceph-mon[40835]: pgmap v1242: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:40.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:40 smithi175 ceph-mon[32813]: pgmap v1243: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:40.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:40 smithi173 ceph-mon[29664]: pgmap v1243: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:40.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:40 smithi173 ceph-mon[40835]: pgmap v1243: 188 pgs: 188 active+clean; 757 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:36:42.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:42 smithi175 ceph-mon[32813]: pgmap v1244: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-11T08:36:42.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:42 smithi173 ceph-mon[29664]: pgmap v1244: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-11T08:36:42.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:42 smithi173 ceph-mon[40835]: pgmap v1244: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 2 op/s 2024-09-11T08:36:44.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:44 smithi175 ceph-mon[32813]: pgmap v1245: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-11T08:36:44.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:44 smithi173 ceph-mon[29664]: pgmap v1245: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-11T08:36:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:44 smithi173 ceph-mon[40835]: pgmap v1245: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 11 KiB/s wr, 1 op/s 2024-09-11T08:36:45.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:45.843 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:45 smithi175 ceph-mon[32813]: pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' is full (reached quota's max_objects: 10) 2024-09-11T08:36:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:45 smithi175 ceph-mon[32813]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:36:45.844 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:45 smithi175 ceph-mon[32813]: osdmap e760: 8 total, 8 up, 8 in 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[29664]: pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' is full (reached quota's max_objects: 10) 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[29664]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[29664]: osdmap e760: 8 total, 8 up, 8 in 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[40835]: pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' is full (reached quota's max_objects: 10) 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[40835]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-09-11T08:36:45.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:45 smithi173 ceph-mon[40835]: osdmap e760: 8 total, 8 up, 8 in 2024-09-11T08:36:47.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:47.536 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:47 smithi173 ceph-mon[29664]: pgmap v1247: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:47.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:47 smithi173 ceph-mon[40835]: pgmap v1247: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:47.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:47 smithi175 ceph-mon[32813]: pgmap v1247: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:47] "GET /metrics HTTP/1.1" 200 228653 "" "Prometheus/2.43.0" 2024-09-11T08:36:48.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:48 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:48.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:48 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:48.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:48 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:49.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:49 smithi175 ceph-mon[32813]: pgmap v1248: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:49.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:49 smithi173 ceph-mon[29664]: pgmap v1248: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:49.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:49 smithi173 ceph-mon[40835]: pgmap v1248: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:51.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:50 smithi175 ceph-mon[32813]: pgmap v1249: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:51.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:50 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[29664]: pgmap v1249: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[40835]: pgmap v1249: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 13 KiB/s wr, 1 op/s 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:36:51.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:50 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:36:53.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:52 smithi175 ceph-mon[32813]: pgmap v1250: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:53.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:52 smithi173 ceph-mon[40835]: pgmap v1250: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:53.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:52 smithi173 ceph-mon[29664]: pgmap v1250: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:55.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:54 smithi175 ceph-mon[32813]: pgmap v1251: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:55.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:54 smithi173 ceph-mon[29664]: pgmap v1251: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:55.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:54 smithi173 ceph-mon[40835]: pgmap v1251: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:36:55.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:36:55 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:36:57.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:36:56 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:36:57.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:56 smithi175 ceph-mon[32813]: pgmap v1252: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-11T08:36:57.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:56 smithi173 ceph-mon[29664]: pgmap v1252: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-11T08:36:57.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:56 smithi173 ceph-mon[40835]: pgmap v1252: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-09-11T08:36:57.790 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:36:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:36:57] "GET /metrics HTTP/1.1" 200 228690 "" "Prometheus/2.43.0" 2024-09-11T08:36:58.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:57 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:58.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:57 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:58.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:57 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:36:59.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:36:58 smithi175 ceph-mon[32813]: pgmap v1253: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:59.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:36:58 smithi173 ceph-mon[29664]: pgmap v1253: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:36:59.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:36:58 smithi173 ceph-mon[40835]: pgmap v1253: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:01.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:00 smithi175 ceph-mon[32813]: pgmap v1254: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:01.215 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:00 smithi173 ceph-mon[29664]: pgmap v1254: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:01.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:00 smithi173 ceph-mon[40835]: pgmap v1254: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:03.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:02 smithi175 ceph-mon[32813]: pgmap v1255: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:03.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:02 smithi173 ceph-mon[29664]: pgmap v1255: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:03.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:02 smithi173 ceph-mon[40835]: pgmap v1255: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:04 smithi175 ceph-mon[32813]: pgmap v1256: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:05.076 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:04 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:04 smithi173 ceph-mon[29664]: pgmap v1256: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:05.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:04 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:05.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:04 smithi173 ceph-mon[40835]: pgmap v1256: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:05.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:04 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:05.343 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:05 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:37:06.625 INFO:tasks.workunit.client.0.smithi173.stderr:+ rados -p 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea put threemore /etc/passwd 2024-09-11T08:37:06.661 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_bytes 0 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/354539105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 msgr2=0x7f9abc1094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/354539105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc1094f0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009d00 tx=0x7f9ab4004d10 comp rx=0 tx=0).stop 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/354539105 shutdown_connections 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/354539105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc1094f0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/354539105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc0fc720 0x7f9abc0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:06.746 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/354539105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc102740 0x7f9abc102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/354539105 >> 172.21.15.173:0/354539105 conn(0x7f9abc0f82c0 msgr2=0x7f9abc0fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/354539105 shutdown_connections 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/354539105 wait complete. 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 Processor -- start 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- start start 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 0x7f9abc111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc102740 0x7f9abc10c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc10cf10 con 0x7f9abc0fd0d0 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc10d080 con 0x7f9abc102740 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.744+0000 7f9ac0c4f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc10d240 con 0x7f9abc0fc720 2024-09-11T08:37:06.747 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 0x7f9abc111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ab9d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ab9d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54888/0 (socket says 172.21.15.173:54888) 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ab9d9b640 1 -- 172.21.15.173:0/4050663340 learned_addr learned my addr 172.21.15.173:0/4050663340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9abad9d640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc102740 0x7f9abc10c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 -- 172.21.15.173:0/4050663340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc102740 msgr2=0x7f9abc10c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc102740 0x7f9abc10c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 -- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 msgr2=0x7f9abc111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac005040 con 0x7f9abc0fc720 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ab9d9b640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aba59c640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 0x7f9abc111660 secure :-1 s=READY pgs=2964 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009400 tx=0x7f9aac009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:06.748 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac007bb0 con 0x7f9abc0fc720 2024-09-11T08:37:06.749 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f9aac00f040 con 0x7f9abc0fc720 2024-09-11T08:37:06.749 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab40098b0 con 0x7f9abc0fc720 2024-09-11T08:37:06.749 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac013af0 con 0x7f9abc0fc720 2024-09-11T08:37:06.749 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.745+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc1195b0 con 0x7f9abc0fc720 2024-09-11T08:37:06.749 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.746+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc0fde60 con 0x7f9abc0fc720 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.747+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f9aac00e8d0 con 0x7f9abc0fc720 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.747+0000 7f9aaaffd640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 0x7f9aa4071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.747+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(760..760 src has 1..760) v4 ==== 9360+0+0 (secure 0 0 0) 0x7f9aac08f010 con 0x7f9abc0fc720 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.747+0000 7f9ab9d9b640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 0x7f9aa4071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.747+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=761}) v3 -- 0x7f9aa407af00 con 0x7f9abc0fc720 2024-09-11T08:37:06.750 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.748+0000 7f9ab9d9b640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 0x7f9aa4071470 secure :-1 s=READY pgs=3639 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0004fd0 tx=0x7f9ab000b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:06.751 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.751+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9aac05b1c0 con 0x7f9abc0fc720 2024-09-11T08:37:06.911 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:06.911+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f9abc10b8e0 con 0x7f9abc0fc720 2024-09-11T08:37:07.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:06 smithi175 ceph-mon[32813]: pgmap v1257: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:07.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:37:06 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:37:07.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:06 smithi173 ceph-mon[29664]: pgmap v1257: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:07.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:06 smithi173 ceph-mon[40835]: pgmap v1257: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:07.820 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:07.820+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 7 ==== osd_map(761..761 src has 1..761) v4 ==== 620+0+0 (secure 0 0 0) 0x7f9aac05af00 con 0x7f9abc0fc720 2024-09-11T08:37:07.821 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:07.821+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=762}) v3 -- 0x7f9aa407bb30 con 0x7f9abc0fc720 2024-09-11T08:37:07.821 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:07] "GET /metrics HTTP/1.1" 200 228721 "" "Prometheus/2.43.0" 2024-09-11T08:37:07.825 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:07.826+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v761) v1 ==== 217+0+0 (secure 0 0 0) 0x7f9aac05ab60 con 0x7f9abc0fc720 2024-09-11T08:37:07.923 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:07.924+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f9abc04bf60 con 0x7f9abc0fc720 2024-09-11T08:37:08.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:07 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:08.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:07 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:07 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:07 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:08.822 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.822+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 9 ==== osd_map(762..762 src has 1..762) v4 ==== 620+0+0 (secure 0 0 0) 0x7f9aac05baf0 con 0x7f9abc0fc720 2024-09-11T08:37:08.822 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.822+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=763}) v3 -- 0x7f9aa407bd60 con 0x7f9abc0fc720 2024-09-11T08:37:08.828 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.828+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4050663340 <== mon.2 v2:172.21.15.173:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v762) v1 ==== 217+0+0 (secure 0 0 0) 0x7f9aac05ad40 con 0x7f9abc0fc720 2024-09-11T08:37:08.828 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_bytes = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:37:08.831 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 msgr2=0x7f9aa4071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:08.831 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 0x7f9aa4071470 secure :-1 s=READY pgs=3639 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0004fd0 tx=0x7f9ab000b040 comp rx=0 tx=0).stop 2024-09-11T08:37:08.831 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 msgr2=0x7f9abc111660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:08.831 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 0x7f9abc111660 secure :-1 s=READY pgs=2964 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009400 tx=0x7f9aac009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.831 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 shutdown_connections 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f9aa406efc0 0x7f9aa4071470 unknown :-1 s=CLOSED pgs=3639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc102740 0x7f9abc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9abc0fd0d0 0x7f9abc111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 --2- 172.21.15.173:0/4050663340 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9abc0fc720 0x7f9abc111660 unknown :-1 s=CLOSED pgs=2964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 >> 172.21.15.173:0/4050663340 conn(0x7f9abc0f82c0 msgr2=0x7f9abc0f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 shutdown_connections 2024-09-11T08:37:08.832 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.831+0000 7f9ac0c4f640 1 -- 172.21.15.173:0/4050663340 wait complete. 2024-09-11T08:37:08.842 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool set-quota 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea max_objects 0 2024-09-11T08:37:08.924 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- 172.21.15.173:0/1665013908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 msgr2=0x7f09200fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 --2- 172.21.15.173:0/1665013908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f09200fb650 secure :-1 s=READY pgs=2965 cs=0 l=1 rev1=1 crypto rx=0x7f0910004950 tx=0x7f0910009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- 172.21.15.173:0/1665013908 shutdown_connections 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 --2- 172.21.15.173:0/1665013908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09200fbd30 0x7f09201083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 --2- 172.21.15.173:0/1665013908 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f09200fb650 unknown :-1 s=CLOSED pgs=2965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 --2- 172.21.15.173:0/1665013908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09201015f0 0x7f09201019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- 172.21.15.173:0/1665013908 >> 172.21.15.173:0/1665013908 conn(0x7f0920072530 msgr2=0x7f09200f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- 172.21.15.173:0/1665013908 shutdown_connections 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- 172.21.15.173:0/1665013908 wait complete. 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 Processor -- start 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.923+0000 7f092839d640 1 -- start start 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200fbd30 0x7f0920112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:08.925 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f092010cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092010d220 con 0x7f09201015f0 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092010d390 con 0x7f09200fbd30 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092010d550 con 0x7f0920101f90 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092693a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f092010cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54914/0 (socket says 172.21.15.173:54914) 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 -- 172.21.15.173:0/218813276 learned_addr learned my addr 172.21.15.173:0/218813276 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0926139640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200fbd30 0x7f0920112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 -- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 msgr2=0x7f092010cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f092010cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 -- 172.21.15.173:0/218813276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200fbd30 msgr2=0x7f0920112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:08.926 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200fbd30 0x7f0920112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180098b0 con 0x7f09201015f0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092693a640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f092010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0925938640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f091002a4a0 tx=0x7f0910035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09100090d0 con 0x7f09201015f0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0910005040 con 0x7f09201015f0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f0910009230 con 0x7f09201015f0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091003c410 con 0x7f09201015f0 2024-09-11T08:37:08.927 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.924+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0920119890 con 0x7f09201015f0 2024-09-11T08:37:08.928 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.925+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200fcd70 con 0x7f09201015f0 2024-09-11T08:37:08.928 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.926+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f0910030020 con 0x7f09201015f0 2024-09-11T08:37:08.928 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.927+0000 7f0916ffd640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 0x7f090c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:08.928 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.927+0000 7f0926139640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 0x7f090c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:08.928 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.927+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(762..762 src has 1..762) v4 ==== 9360+0+0 (secure 0 0 0) 0x7f09100aede0 con 0x7f09201015f0 2024-09-11T08:37:08.929 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.927+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=763}) v3 -- 0x7f090c07af00 con 0x7f09201015f0 2024-09-11T08:37:08.929 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.927+0000 7f0926139640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 0x7f090c071470 secure :-1 s=READY pgs=3640 cs=0 l=1 rev1=1 crypto rx=0x7f091c004a70 tx=0x7f091c00b040 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:08.931 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:08.931+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f091007b010 con 0x7f09201015f0 2024-09-11T08:37:09.088 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:09.088+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f092010e0b0 con 0x7f09201015f0 2024-09-11T08:37:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:08 smithi175 ceph-mon[32813]: pgmap v1258: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:08 smithi175 ceph-mon[32813]: osdmap e761: 8 total, 8 up, 8 in 2024-09-11T08:37:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:08 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:08 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.215 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[29664]: pgmap v1258: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[29664]: osdmap e761: 8 total, 8 up, 8 in 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[40835]: pgmap v1258: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[40835]: osdmap e761: 8 total, 8 up, 8 in 2024-09-11T08:37:09.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/4050663340' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:08 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]: dispatch 2024-09-11T08:37:09.838 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:09.838+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 7 ==== osd_map(763..763 src has 1..763) v4 ==== 620+0+0 (secure 0 0 0) 0x7f091007ad50 con 0x7f09201015f0 2024-09-11T08:37:09.838 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:09.838+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=764}) v3 -- 0x7f090c07bb30 con 0x7f09201015f0 2024-09-11T08:37:09.841 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:09.841+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v763) v1 ==== 221+0+0 (secure 0 0 0) 0x7f091007a9b0 con 0x7f09201015f0 2024-09-11T08:37:09.938 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:09.938+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f092004bf60 con 0x7f09201015f0 2024-09-11T08:37:10.093 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:09 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:09 smithi175 ceph-mon[32813]: osdmap e762: 8 total, 8 up, 8 in 2024-09-11T08:37:10.094 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:09 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:10.215 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[29664]: osdmap e762: 8 total, 8 up, 8 in 2024-09-11T08:37:10.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_bytes", "val": "0"}]': finished 2024-09-11T08:37:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[40835]: osdmap e762: 8 total, 8 up, 8 in 2024-09-11T08:37:10.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:09 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:10.838 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.838+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 9 ==== osd_map(764..764 src has 1..764) v4 ==== 620+0+0 (secure 0 0 0) 0x7f091007b940 con 0x7f09201015f0 2024-09-11T08:37:10.838 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.838+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7f090c07bd60 con 0x7f09201015f0 2024-09-11T08:37:10.842 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.842+0000 7f0916ffd640 1 -- 172.21.15.173:0/218813276 <== mon.0 v2:172.21.15.173:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea v764) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0910086030 con 0x7f09201015f0 2024-09-11T08:37:10.842 INFO:tasks.workunit.client.0.smithi173.stderr:set-quota max_objects = 0 for pool 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 msgr2=0x7f090c071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 0x7f090c071470 secure :-1 s=READY pgs=3640 cs=0 l=1 rev1=1 crypto rx=0x7f091c004a70 tx=0x7f091c00b040 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 msgr2=0x7f0920112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f091002a4a0 tx=0x7f0910035040 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 shutdown_connections 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f090c06efc0 0x7f090c071470 unknown :-1 s=CLOSED pgs=3640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0920101f90 0x7f092010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09201015f0 0x7f0920112f80 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 --2- 172.21.15.173:0/218813276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200fbd30 0x7f0920112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:10.846 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 >> 172.21.15.173:0/218813276 conn(0x7f0920072530 msgr2=0x7f09200ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:10.847 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 shutdown_connections 2024-09-11T08:37:10.847 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:10.846+0000 7f092839d640 1 -- 172.21.15.173:0/218813276 wait complete. 2024-09-11T08:37:10.857 INFO:tasks.workunit.client.0.smithi173.stderr:+ sleep 30 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[29664]: pgmap v1261: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[29664]: osdmap e763: 8 total, 8 up, 8 in 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[40835]: pgmap v1261: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[40835]: osdmap e763: 8 total, 8 up, 8 in 2024-09-11T08:37:11.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:10 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:11.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:10 smithi175 ceph-mon[32813]: pgmap v1261: 188 pgs: 188 active+clean; 882 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-11T08:37:11.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:10 smithi175 ceph-mon[32813]: osdmap e763: 8 total, 8 up, 8 in 2024-09-11T08:37:11.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:10 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]: dispatch 2024-09-11T08:37:12.215 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:11 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:12.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:11 smithi173 ceph-mon[29664]: osdmap e764: 8 total, 8 up, 8 in 2024-09-11T08:37:12.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:11 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:12.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:11 smithi173 ceph-mon[40835]: osdmap e764: 8 total, 8 up, 8 in 2024-09-11T08:37:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:11 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/218813276' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "field": "max_objects", "val": "0"}]': finished 2024-09-11T08:37:12.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:11 smithi175 ceph-mon[32813]: osdmap e764: 8 total, 8 up, 8 in 2024-09-11T08:37:13.215 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:12 smithi173 ceph-mon[29664]: pgmap v1264: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:37:13.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:12 smithi173 ceph-mon[40835]: pgmap v1264: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:37:13.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:12 smithi175 ceph-mon[32813]: pgmap v1264: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-09-11T08:37:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:37:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:37:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:37:14.216 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:37:14.216 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:37:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:37:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:37:14.217 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:13 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:37:14.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T08:37:14.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T08:37:14.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T08:37:14.345 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:13 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' 2024-09-11T08:37:15.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:15 smithi175 ceph-mon[32813]: pgmap v1265: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 907 B/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-11T08:37:15.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:15 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:37:15.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:15 smithi173 ceph-mon[29664]: pgmap v1265: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 907 B/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-11T08:37:15.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:15 smithi173 ceph-mon[40835]: pgmap v1265: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 907 B/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-11T08:37:17.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:37:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:37:17.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:17 smithi173 ceph-mon[40835]: pgmap v1266: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 771 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-09-11T08:37:17.518 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:17 smithi173 ceph-mon[29664]: pgmap v1266: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 771 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-09-11T08:37:17.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:17 smithi175 ceph-mon[32813]: pgmap v1266: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 771 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-09-11T08:37:17.965 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:17 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:17] "GET /metrics HTTP/1.1" 200 228721 "" "Prometheus/2.43.0" 2024-09-11T08:37:18.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:18 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:18.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:18 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:18.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:18 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:19.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:19 smithi175 ceph-mon[32813]: pgmap v1267: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:37:19.715 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:19 smithi173 ceph-mon[29664]: pgmap v1267: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:37:19.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:19 smithi173 ceph-mon[40835]: pgmap v1267: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T08:37:20.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:20 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:20.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:20 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:20.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:20 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:21.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:21 smithi175 ceph-mon[32813]: pgmap v1268: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-11T08:37:21.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:21 smithi173 ceph-mon[29664]: pgmap v1268: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-11T08:37:21.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:21 smithi173 ceph-mon[40835]: pgmap v1268: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-09-11T08:37:23.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:23 smithi175 ceph-mon[32813]: pgmap v1269: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 963 B/s rd, 0 op/s 2024-09-11T08:37:23.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:23 smithi173 ceph-mon[29664]: pgmap v1269: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 963 B/s rd, 0 op/s 2024-09-11T08:37:23.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:23 smithi173 ceph-mon[40835]: pgmap v1269: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 963 B/s rd, 0 op/s 2024-09-11T08:37:25.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:25 smithi175 ceph-mon[32813]: pgmap v1270: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:25.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:25] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:37:25.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:25 smithi173 ceph-mon[29664]: pgmap v1270: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:25.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:25 smithi173 ceph-mon[40835]: pgmap v1270: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:27.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:37:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:37:27.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:27 smithi175 ceph-mon[32813]: pgmap v1271: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:27.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:27 smithi173 ceph-mon[29664]: pgmap v1271: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:27.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:27 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:27] "GET /metrics HTTP/1.1" 200 228723 "" "Prometheus/2.43.0" 2024-09-11T08:37:27.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:27 smithi173 ceph-mon[40835]: pgmap v1271: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:28.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:28 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:28.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:28 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:28.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:28 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:29.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:29 smithi175 ceph-mon[32813]: pgmap v1272: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:29.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:29 smithi173 ceph-mon[29664]: pgmap v1272: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:29.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:29 smithi173 ceph-mon[40835]: pgmap v1272: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:31.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:31 smithi175 ceph-mon[32813]: pgmap v1273: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:31.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:31 smithi173 ceph-mon[29664]: pgmap v1273: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:31.717 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:31 smithi173 ceph-mon[40835]: pgmap v1273: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:33.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:33 smithi175 ceph-mon[32813]: pgmap v1274: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:33.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:33 smithi173 ceph-mon[29664]: pgmap v1274: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:33.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:33 smithi173 ceph-mon[40835]: pgmap v1274: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:35.343 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:35 smithi175 ceph-mon[32813]: pgmap v1275: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:35.344 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:35 smithi175 ceph-mon[32813]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:35.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:37:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:35 smithi173 ceph-mon[29664]: pgmap v1275: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:35.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:35 smithi173 ceph-mon[29664]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:35.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:35 smithi173 ceph-mon[40835]: pgmap v1275: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-11T08:37:35.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:35 smithi173 ceph-mon[40835]: from='mgr.14556 172.21.15.173:0/3991224364' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T08:37:37.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:37:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:37:37.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:37 smithi175 ceph-mon[32813]: pgmap v1276: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:37.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:37 smithi173 ceph-mon[29664]: pgmap v1276: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:37.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:37 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:37] "GET /metrics HTTP/1.1" 200 228708 "" "Prometheus/2.43.0" 2024-09-11T08:37:37.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:37 smithi173 ceph-mon[40835]: pgmap v1276: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:38.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:38 smithi175 ceph-mon[32813]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:38.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:38 smithi173 ceph-mon[29664]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:38.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:38 smithi173 ceph-mon[40835]: from='client.24428 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-11T08:37:39.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:39 smithi175 ceph-mon[32813]: pgmap v1277: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:39.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:39 smithi173 ceph-mon[29664]: pgmap v1277: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:39.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:39 smithi173 ceph-mon[40835]: pgmap v1277: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T08:37:40.859 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool delete 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea 6b43934a-bbb8-4476-ab8e-43d83ecfc2ea --yes-i-really-really-mean-it 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 -- 172.21.15.173:0/3721150922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac1015f0 msgr2=0x7f60ac1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 --2- 172.21.15.173:0/3721150922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac1015f0 0x7f60ac1019c0 secure :-1 s=READY pgs=2966 cs=0 l=1 rev1=1 crypto rx=0x7f609c004950 tx=0x7f609c009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 -- 172.21.15.173:0/3721150922 shutdown_connections 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 --2- 172.21.15.173:0/3721150922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac0fbd30 0x7f60ac1083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 --2- 172.21.15.173:0/3721150922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac0fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 --2- 172.21.15.173:0/3721150922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac1015f0 0x7f60ac1019c0 unknown :-1 s=CLOSED pgs=2966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.948 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 -- 172.21.15.173:0/3721150922 >> 172.21.15.173:0/3721150922 conn(0x7f60ac072530 msgr2=0x7f60ac0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 -- 172.21.15.173:0/3721150922 shutdown_connections 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.945+0000 7f60b2034640 1 -- 172.21.15.173:0/3721150922 wait complete. 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 Processor -- start 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 -- start start 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 0x7f60ac112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac10cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:40.949 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac10d240 con 0x7f60ac101f90 2024-09-11T08:37:40.952 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac10d3b0 con 0x7f60ac1015f0 2024-09-11T08:37:40.952 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60b2034640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac10d570 con 0x7f60ac0fbd30 2024-09-11T08:37:40.952 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60ab7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:40.952 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60ab7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38650/0 (socket says 172.21.15.173:38650) 2024-09-11T08:37:40.952 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60ab7fe640 1 -- 172.21.15.173:0/616093928 learned_addr learned my addr 172.21.15.173:0/616093928 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.946+0000 7f60abfff640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac10cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60a2ffd640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 0x7f60ac112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 -- 172.21.15.173:0/616093928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 msgr2=0x7f60ac112fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 0x7f60ac112fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 -- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 msgr2=0x7f60ac10cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac10cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094005040 con 0x7f60ac0fbd30 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60a2ffd640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 0x7f60ac112fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60abfff640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac10cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60ab7fe640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 secure :-1 s=READY pgs=2967 cs=0 l=1 rev1=1 crypto rx=0x7f609c009040 tx=0x7f609c035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c009530 con 0x7f60ac0fbd30 2024-09-11T08:37:40.953 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f609c033860 con 0x7f60ac0fbd30 2024-09-11T08:37:40.954 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c005040 con 0x7f60ac0fbd30 2024-09-11T08:37:40.954 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c03c620 con 0x7f60ac0fbd30 2024-09-11T08:37:40.954 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.947+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac1198b0 con 0x7f60ac0fbd30 2024-09-11T08:37:40.954 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.948+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac0fcd70 con 0x7f60ac0fbd30 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.949+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f609c030020 con 0x7f60ac0fbd30 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.949+0000 7f60a8ff9640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 0x7f6098071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.949+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(764..764 src has 1..764) v4 ==== 9360+0+0 (secure 0 0 0) 0x7f609c0aed90 con 0x7f60ac0fbd30 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.949+0000 7f60a2ffd640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 0x7f6098071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.949+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7f609807af00 con 0x7f60ac0fbd30 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.950+0000 7f60a2ffd640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 0x7f6098071470 secure :-1 s=READY pgs=3641 cs=0 l=1 rev1=1 crypto rx=0x7f6094009fd0 tx=0x7f6094009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:40.955 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:40.953+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f609c07b080 con 0x7f60ac0fbd30 2024-09-11T08:37:41.109 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.110+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60ac10a890 con 0x7f60ac0fbd30 2024-09-11T08:37:41.320 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.320+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 7 ==== osd_map(765..765 src has 1..765) v4 ==== 288+0+0 (secure 0 0 0) 0x7f609c0b3070 con 0x7f60ac0fbd30 2024-09-11T08:37:41.321 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.320+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=766}) v3 -- 0x7f609807b850 con 0x7f60ac0fbd30 2024-09-11T08:37:41.324 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.325+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]=0 pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' removed v765) v1 ==== 248+0+0 (secure 0 0 0) 0x7f609c07aa20 con 0x7f60ac0fbd30 2024-09-11T08:37:41.421 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.422+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60ac10e0d0 con 0x7f60ac0fbd30 2024-09-11T08:37:41.422 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.422+0000 7f60a8ff9640 1 -- 172.21.15.173:0/616093928 <== mon.2 v2:172.21.15.173:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]=0 pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' does not exist v765) v1 ==== 255+0+0 (secure 0 0 0) 0x7f609c07ac00 con 0x7f60ac0fbd30 2024-09-11T08:37:41.422 INFO:tasks.workunit.client.0.smithi173.stderr:pool '6b43934a-bbb8-4476-ab8e-43d83ecfc2ea' does not exist 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 msgr2=0x7f6098071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 0x7f6098071470 secure :-1 s=READY pgs=3641 cs=0 l=1 rev1=1 crypto rx=0x7f6094009fd0 tx=0x7f6094009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 msgr2=0x7f60ac112a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 secure :-1 s=READY pgs=2967 cs=0 l=1 rev1=1 crypto rx=0x7f609c009040 tx=0x7f609c035040 comp rx=0 tx=0).stop 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 shutdown_connections 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f609806efc0 0x7f6098071470 unknown :-1 s=CLOSED pgs=3641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ac101f90 0x7f60ac10cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.425 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ac1015f0 0x7f60ac112fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.426 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 --2- 172.21.15.173:0/616093928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60ac0fbd30 0x7f60ac112a60 unknown :-1 s=CLOSED pgs=2967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.426 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 >> 172.21.15.173:0/616093928 conn(0x7f60ac072530 msgr2=0x7f60ac073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:41.426 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 shutdown_connections 2024-09-11T08:37:41.426 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.425+0000 7f60b2034640 1 -- 172.21.15.173:0/616093928 wait complete. 2024-09-11T08:37:41.433 INFO:tasks.workunit.client.0.smithi173.stderr:+ ceph osd pool delete 81eb9a0c-cdba-4538-b88a-81daa6fd2327 81eb9a0c-cdba-4538-b88a-81daa6fd2327 --yes-i-really-really-mean-it 2024-09-11T08:37:41.512 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- 172.21.15.173:0/1524774719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c1026d0 msgr2=0x7f710c102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 --2- 172.21.15.173:0/1524774719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c1026d0 0x7f710c102aa0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0048c0 tx=0x7f70fc009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- 172.21.15.173:0/1524774719 shutdown_connections 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 --2- 172.21.15.173:0/1524774719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 0x7f710c109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 --2- 172.21.15.173:0/1524774719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c103070 0x7f710c0fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 --2- 172.21.15.173:0/1524774719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c1026d0 0x7f710c102aa0 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- 172.21.15.173:0/1524774719 >> 172.21.15.173:0/1524774719 conn(0x7f710c0f82e0 msgr2=0x7f710c0fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- 172.21.15.173:0/1524774719 shutdown_connections 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- 172.21.15.173:0/1524774719 wait complete. 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 Processor -- start 2024-09-11T08:37:41.513 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.511+0000 7f7110a89640 1 -- start start 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 0x7f710c112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 0x7f710c10cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c10d280 con 0x7f710c103070 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c10d3f0 con 0x7f710c0fce70 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c10d5b0 con 0x7f710c1026d0 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7109d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 0x7f710c10cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7109d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38668/0 (socket says 172.21.15.173:38668) 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7109d9b640 1 -- 172.21.15.173:0/1150190101 learned_addr learned my addr 172.21.15.173:0/1150190101 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710a59c640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 0x7f710c112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 -- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 msgr2=0x7f710c112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:41.514 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 -- 172.21.15.173:0/1150190101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 msgr2=0x7f710c112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 0x7f710c112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100005040 con 0x7f710c103070 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7109d9b640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f710ad9d640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 0x7f710c10cc30 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f710400db80 tx=0x7f7104004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104017070 con 0x7f710c103070 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(22 keys) v1 ==== 968+0+0 (secure 0 0 0) 0x7f710400f040 con 0x7f710c103070 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc005040 con 0x7f710c103070 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040036a0 con 0x7f710c103070 2024-09-11T08:37:41.515 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.512+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c1198f0 con 0x7f710c103070 2024-09-11T08:37:41.516 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.513+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c0fde80 con 0x7f710c103070 2024-09-11T08:37:41.516 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.514+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) v1 ==== 90839+0+0 (secure 0 0 0) 0x7f7104003ad0 con 0x7f710c103070 2024-09-11T08:37:41.516 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.514+0000 7f70faffd640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 0x7f70f4071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T08:37:41.516 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.514+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(765..765 src has 1..765) v4 ==== 8972+0+0 (secure 0 0 0) 0x7f710408eeb0 con 0x7f710c103070 2024-09-11T08:37:41.516 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.514+0000 7f710a59c640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 0x7f70f4071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T08:37:41.517 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.514+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=766}) v3 -- 0x7f70f407a760 con 0x7f710c103070 2024-09-11T08:37:41.517 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.515+0000 7f710a59c640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 0x7f70f4071470 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02a4c0 tx=0x7f70fc009da0 comp rx=0 tx=0).ready entity=mgr.14556 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T08:37:41.518 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.518+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f710405b310 con 0x7f710c103070 2024-09-11T08:37:41.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:41 smithi175 ceph-mon[32813]: pgmap v1278: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:41.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:41 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:41.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:41 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:41.673 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:41.673+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f710c10e110 con 0x7f710c103070 2024-09-11T08:37:41.715 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[29664]: pgmap v1278: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:41.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:41.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:41.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[40835]: pgmap v1278: 188 pgs: 188 active+clean; 894 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-11T08:37:41.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:41.716 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:41 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.336 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.336+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 7 ==== osd_map(766..766 src has 1..766) v4 ==== 288+0+0 (secure 0 0 0) 0x7f710405b050 con 0x7f710c103070 2024-09-11T08:37:42.336 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.336+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=767}) v3 -- 0x7f70f407afe0 con 0x7f710c103070 2024-09-11T08:37:42.345 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.346+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]=0 pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' removed v766) v1 ==== 248+0+0 (secure 0 0 0) 0x7f710405acb0 con 0x7f710c103070 2024-09-11T08:37:42.445 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.445+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f710c119a80 con 0x7f710c103070 2024-09-11T08:37:42.445 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.445+0000 7f70faffd640 1 -- 172.21.15.173:0/1150190101 <== mon.0 v2:172.21.15.173:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]=0 pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' does not exist v766) v1 ==== 255+0+0 (secure 0 0 0) 0x7f710405ae90 con 0x7f710c103070 2024-09-11T08:37:42.446 INFO:tasks.workunit.client.0.smithi173.stderr:pool '81eb9a0c-cdba-4538-b88a-81daa6fd2327' does not exist 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 msgr2=0x7f70f4071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 0x7f70f4071470 secure :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02a4c0 tx=0x7f70fc009da0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 msgr2=0x7f710c10cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 0x7f710c10cc30 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f710400db80 tx=0x7f7104004db0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 shutdown_connections 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:6800/2824501820,v1:172.21.15.173:6801/2824501820] conn(0x7f70f406efc0 0x7f70f4071470 unknown :-1 s=CLOSED pgs=3642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f710c103070 0x7f710c10cc30 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f710c1026d0 0x7f710c112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 --2- 172.21.15.173:0/1150190101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0fce70 0x7f710c112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 >> 172.21.15.173:0/1150190101 conn(0x7f710c0f82e0 msgr2=0x7f710c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T08:37:42.448 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 shutdown_connections 2024-09-11T08:37:42.449 INFO:tasks.workunit.client.0.smithi173.stderr:2024-09-11T08:37:42.448+0000 7f7110a89640 1 -- 172.21.15.173:0/1150190101 wait complete. 2024-09-11T08:37:42.456 INFO:tasks.workunit.client.0.smithi173.stderr:+ echo OK 2024-09-11T08:37:42.457 INFO:tasks.workunit.client.0.smithi173.stdout:OK 2024-09-11T08:37:42.458 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T08:37:42.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T08:37:42.525 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-09-11T08:37:42.525 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T08:37:42.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:42.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[40835]: osdmap e765: 8 total, 8 up, 8 in 2024-09-11T08:37:42.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[40835]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[29664]: osdmap e765: 8 total, 8 up, 8 in 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[29664]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.587 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:42 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:42 smithi175 ceph-mon[32813]: osdmap e765: 8 total, 8 up, 8 in 2024-09-11T08:37:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/616093928' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:42 smithi175 ceph-mon[32813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "pool2": "6b43934a-bbb8-4476-ab8e-43d83ecfc2ea", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:42 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:42.826 DEBUG:teuthology.parallel:result is None 2024-09-11T08:37:42.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T08:37:42.890 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T08:37:42.890 DEBUG:teuthology.orchestra.run.smithi173:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T08:37:42.949 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T08:37:42.949 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T08:37:42.959 INFO:tasks.cephadm:Teardown begin 2024-09-11T08:37:42.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:37:43.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:37:43.048 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T08:37:43.049 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T08:37:43.069 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T08:37:43.106 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T08:37:43.106 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T08:37:43.106 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a 2024-09-11T08:37:43.415 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 systemd[1]: Stopping Ceph mon.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[29664]: pgmap v1280: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[29664]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[29664]: osdmap e766: 8 total, 8 up, 8 in 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[29664]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[40835]: pgmap v1280: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[40835]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[40835]: osdmap e766: 8 total, 8 up, 8 in 2024-09-11T08:37:43.416 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-mon[40835]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:43.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:43 smithi175 ceph-mon[32813]: pgmap v1280: 176 pgs: 176 active+clean; 707 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-11T08:37:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:43 smithi175 ceph-mon[32813]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-09-11T08:37:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T08:37:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:43 smithi175 ceph-mon[32813]: osdmap e766: 8 total, 8 up, 8 in 2024-09-11T08:37:43.594 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:43 smithi175 ceph-mon[32813]: from='client.? 172.21.15.173:0/1150190101' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "pool2": "81eb9a0c-cdba-4538-b88a-81daa6fd2327", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a[29641]: 2024-09-11T08:37:43.415+0000 7fdd3f77b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a[29641]: 2024-09-11T08:37:43.415+0000 7fdd3f77b640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 podman[150442]: 2024-09-11 08:37:43.446419917 +0000 UTC m=+0.158257302 container died e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE Bus STOPPING 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE Bus STOPPED 2024-09-11T08:37:43.716 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE Bus STARTING 2024-09-11T08:37:43.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE Serving on http://:::9283 2024-09-11T08:37:43.717 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: [11/Sep/2024:08:37:43] ENGINE Bus STARTED 2024-09-11T08:37:44.156 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 podman[150442]: 2024-09-11 08:37:43.888903354 +0000 UTC m=+0.600740744 container cleanup e95992dc41202c6aa14ce42ef046c9ca3e103d533d32dd5e370ccc3adfdd15ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:37:44.156 INFO:journalctl@ceph.mon.a.smithi173.stdout:Sep 11 08:37:43 smithi173 bash[150442]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-a 2024-09-11T08:37:44.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T08:37:44.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:44.347 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T08:37:44.348 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-11T08:37:44.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.c 2024-09-11T08:37:44.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:44 smithi173 systemd[1]: Stopping Ceph mon.c for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:44 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c[40812]: 2024-09-11T08:37:44.677+0000 7f446d1ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:44 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c[40812]: 2024-09-11T08:37:44.677+0000 7f446d1ce640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T08:37:44.966 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:44 smithi173 podman[150584]: 2024-09-11 08:37:44.84228065 +0000 UTC m=+0.277134850 container died d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T08:37:45.344 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x[34872]: ::ffff:172.21.15.175 - - [11/Sep/2024:08:37:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-11T08:37:45.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:45 smithi173 podman[150584]: 2024-09-11 08:37:45.210239511 +0000 UTC m=+0.645093708 container cleanup d1f2b0efd539c04c31b7a64d6626307a6bdbc752436353ea6e337d88dee107e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T08:37:45.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 11 08:37:45 smithi173 bash[150584]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-c 2024-09-11T08:37:45.630 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T08:37:45.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:45.664 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-11T08:37:45.664 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-11T08:37:45.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.b 2024-09-11T08:37:45.958 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:45 smithi175 systemd[1]: Stopping Ceph mon.b for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:46.299 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-b[32788]: 2024-09-11T08:37:45.957+0000 7fd2d4c82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:46.299 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-b[32788]: 2024-09-11T08:37:45.957+0000 7fd2d4c82640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T08:37:46.299 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:46 smithi175 podman[71586]: 2024-09-11 08:37:46.030865981 +0000 UTC m=+0.170463362 container died ebade2c13fd52b14a3c0da4c59bbf1b7c6283c36b090154ae50883b9d7e93952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T08:37:46.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:46 smithi175 podman[71586]: 2024-09-11 08:37:46.507306656 +0000 UTC m=+0.646904075 container cleanup ebade2c13fd52b14a3c0da4c59bbf1b7c6283c36b090154ae50883b9d7e93952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T08:37:46.593 INFO:journalctl@ceph.mon.b.smithi175.stdout:Sep 11 08:37:46 smithi175 bash[71586]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mon-b 2024-09-11T08:37:46.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T08:37:46.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:46.994 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-11T08:37:46.994 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T08:37:46.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y 2024-09-11T08:37:47.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:37:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug there is no tcmu-runner data available 2024-09-11T08:37:47.324 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:47 smithi173 systemd[1]: Stopping Ceph mgr.y for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:47.606 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:47 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y[29918]: 2024-09-11T08:37:47.323+0000 7f4d93ab7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:47.606 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:47 smithi173 podman[150718]: 2024-09-11 08:37:47.356155876 +0000 UTC m=+0.174402201 container died 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T08:37:47.965 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:47 smithi173 podman[150718]: 2024-09-11 08:37:47.70637796 +0000 UTC m=+0.524624273 container cleanup 4d54a0e8623d512fde04f3ee3d6a073be7e4fae8a8f92090c36720374c146c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0e6828a2016d48cf25ad84064e50742bb1c39b9, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T08:37:47.966 INFO:journalctl@ceph.mgr.y.smithi173.stdout:Sep 11 08:37:47 smithi173 bash[150718]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-y 2024-09-11T08:37:48.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T08:37:48.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:48.197 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T08:37:48.197 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T08:37:48.198 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.x 2024-09-11T08:37:48.594 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:48 smithi175 systemd[1]: Stopping Ceph mgr.x for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:48.945 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:48 smithi175 podman[71718]: 2024-09-11 08:37:48.627256781 +0000 UTC m=+0.235692899 container died 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T08:37:48.945 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:48 smithi175 podman[71718]: 2024-09-11 08:37:48.945816387 +0000 UTC m=+0.554252548 container cleanup 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T08:37:49.324 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:48 smithi175 bash[71718]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x 2024-09-11T08:37:49.325 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:49 smithi175 podman[71735]: 2024-09-11 08:37:49.121994504 +0000 UTC m=+0.489073872 container remove 744a9ae24344aad51ae8014653277d6496753ef8032a03b512dceac173e89cea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:37:49.325 INFO:journalctl@ceph.mgr.x.smithi175.stdout:Sep 11 08:37:49 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-11T08:37:49.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T08:37:49.371 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:49.371 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T08:37:49.372 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T08:37:49.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.0 2024-09-11T08:37:49.688 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:49 smithi173 systemd[1]: Stopping Ceph osd.0 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:49.965 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:49 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:37:49.688+0000 7fbde2102640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:49.966 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:49 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:37:49.688+0000 7fbde2102640 -1 osd.0 766 *** Got signal Terminated *** 2024-09-11T08:37:49.966 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:49 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0[45081]: 2024-09-11T08:37:49.688+0000 7fbde2102640 -1 osd.0 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:37:50.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:37:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:37:50.147Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:37:50.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:37:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:37:50.148Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:37:53.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:37:53 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:37:53.574Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:37:53.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:37:53 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:37:53.574Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:37:55.466 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:55 smithi173 podman[150864]: 2024-09-11 08:37:55.213503254 +0000 UTC m=+5.655397658 container died dfe5352a129c865cec50617a446b2d51949eb5528caa28ba5205eeec82c8d7dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:37:55.836 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:55 smithi173 podman[150864]: 2024-09-11 08:37:55.610697095 +0000 UTC m=+6.052591489 container cleanup dfe5352a129c865cec50617a446b2d51949eb5528caa28ba5205eeec82c8d7dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T08:37:55.836 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:55 smithi173 bash[150864]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0 2024-09-11T08:37:56.142 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:55 smithi173 podman[150883]: 2024-09-11 08:37:55.83697842 +0000 UTC m=+0.624274534 container remove dfe5352a129c865cec50617a446b2d51949eb5528caa28ba5205eeec82c8d7dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T08:37:56.432 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.046118422 +0000 UTC m=+0.015880124 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:37:56.432 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.171242739 +0000 UTC m=+0.141004478 container create ea2ab50ae95fd41b9bae5d777a48edffe3c2c9ede50ba37d03fbb6d78cc8626c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T08:37:56.432 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.432928116 +0000 UTC m=+0.402689831 container init ea2ab50ae95fd41b9bae5d777a48edffe3c2c9ede50ba37d03fbb6d78cc8626c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T08:37:56.716 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.437976748 +0000 UTC m=+0.407738445 container start ea2ab50ae95fd41b9bae5d777a48edffe3c2c9ede50ba37d03fbb6d78cc8626c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T08:37:56.716 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.540739729 +0000 UTC m=+0.510501431 container attach ea2ab50ae95fd41b9bae5d777a48edffe3c2c9ede50ba37d03fbb6d78cc8626c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-11T08:37:56.716 INFO:journalctl@ceph.osd.0.smithi173.stdout:Sep 11 08:37:56 smithi173 podman[150977]: 2024-09-11 08:37:56.609124821 +0000 UTC m=+0.578886533 container died ea2ab50ae95fd41b9bae5d777a48edffe3c2c9ede50ba37d03fbb6d78cc8626c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T08:37:57.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T08:37:57.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:37:57.246 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T08:37:57.246 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T08:37:57.246 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.1 2024-09-11T08:37:57.466 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:37:57 smithi173 systemd[1]: Stopping Ceph osd.1 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:37:57.965 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:37:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1[51250]: 2024-09-11T08:37:57.587+0000 7fe707bc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:37:57.966 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:37:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1[51250]: 2024-09-11T08:37:57.587+0000 7fe707bc5640 -1 osd.1 766 *** Got signal Terminated *** 2024-09-11T08:37:57.966 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:37:57 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1[51250]: 2024-09-11T08:37:57.587+0000 7fe707bc5640 -1 osd.1 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:00.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:00.147Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:00.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:00.147Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:00.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:00.148Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:03.358 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:03 smithi173 podman[151107]: 2024-09-11 08:38:03.090620012 +0000 UTC m=+5.624387274 container died 035d410832ddf4f6f539bef6457d22f0296ebf0cbb0dde0a828decb667372859 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T08:38:03.643 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:03 smithi173 podman[151107]: 2024-09-11 08:38:03.432294263 +0000 UTC m=+5.966061514 container cleanup 035d410832ddf4f6f539bef6457d22f0296ebf0cbb0dde0a828decb667372859 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:03.643 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:03 smithi173 bash[151107]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1 2024-09-11T08:38:03.643 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:03.574Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:03.643 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:03.575Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:03.643 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:03.575Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:03.965 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:03 smithi173 podman[151134]: 2024-09-11 08:38:03.643742983 +0000 UTC m=+0.546178486 container remove 035d410832ddf4f6f539bef6457d22f0296ebf0cbb0dde0a828decb667372859 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T08:38:04.343 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:03.951753367 +0000 UTC m=+0.016301507 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:04.343 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:04.103455823 +0000 UTC m=+0.168003957 container create 34349b38377d48f5b5039eddd470c2e29fbc3be032d35285a30716db3e714314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T08:38:04.671 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:04.489440868 +0000 UTC m=+0.553989003 container init 34349b38377d48f5b5039eddd470c2e29fbc3be032d35285a30716db3e714314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T08:38:04.672 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:04.494532126 +0000 UTC m=+0.559080258 container start 34349b38377d48f5b5039eddd470c2e29fbc3be032d35285a30716db3e714314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:38:04.672 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:04.572115439 +0000 UTC m=+0.636663595 container attach 34349b38377d48f5b5039eddd470c2e29fbc3be032d35285a30716db3e714314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T08:38:04.966 INFO:journalctl@ceph.osd.1.smithi173.stdout:Sep 11 08:38:04 smithi173 podman[151228]: 2024-09-11 08:38:04.672893561 +0000 UTC m=+0.737441693 container died 34349b38377d48f5b5039eddd470c2e29fbc3be032d35285a30716db3e714314 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:38:05.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T08:38:05.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:05.303 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T08:38:05.303 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T08:38:05.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.2 2024-09-11T08:38:05.630 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:05 smithi173 systemd[1]: Stopping Ceph osd.2 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:05.965 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:05 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2[57659]: 2024-09-11T08:38:05.629+0000 7fd8495e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:05.965 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:05 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2[57659]: 2024-09-11T08:38:05.629+0000 7fd8495e1640 -1 osd.2 766 *** Got signal Terminated *** 2024-09-11T08:38:05.966 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:05 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2[57659]: 2024-09-11T08:38:05.629+0000 7fd8495e1640 -1 osd.2 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:10.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:10 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:10.148Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:10.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:10 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:10.148Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:10.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:10 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:10.149Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:11.432 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:11 smithi173 podman[151360]: 2024-09-11 08:38:11.142738575 +0000 UTC m=+5.613012660 container died fb823d604b4068dbd770680e62cdb208e89998e75a49d620f31be56a4b8c14bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T08:38:11.715 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:11 smithi173 podman[151360]: 2024-09-11 08:38:11.509196113 +0000 UTC m=+5.979470193 container cleanup fb823d604b4068dbd770680e62cdb208e89998e75a49d620f31be56a4b8c14bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T08:38:11.716 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:11 smithi173 bash[151360]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2 2024-09-11T08:38:12.076 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:11 smithi173 podman[151379]: 2024-09-11 08:38:11.771441771 +0000 UTC m=+0.625555494 container remove fb823d604b4068dbd770680e62cdb208e89998e75a49d620f31be56a4b8c14bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T08:38:12.386 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:11.980191238 +0000 UTC m=+0.015672298 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:12.386 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:12.098809608 +0000 UTC m=+0.134290653 container create 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T08:38:12.386 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:12.30345549 +0000 UTC m=+0.338936539 container init 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T08:38:12.386 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:12.308453605 +0000 UTC m=+0.343934651 container start 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:38:12.386 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:12.386592356 +0000 UTC m=+0.422073409 container attach 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_CLEAN=True) 2024-09-11T08:38:12.715 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151473]: 2024-09-11 08:38:12.488549027 +0000 UTC m=+0.524030080 container died 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:38:13.016 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 11 08:38:12 smithi173 podman[151516]: 2024-09-11 08:38:12.998276895 +0000 UTC m=+0.503646323 container remove 93b0680710ea0ec9ed0b8cc572407a9d067a2e31b30d9924c338f9f8c94d2206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T08:38:13.021 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T08:38:13.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:13.060 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T08:38:13.061 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T08:38:13.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.3 2024-09-11T08:38:13.395 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:13 smithi173 systemd[1]: Stopping Ceph osd.3 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:13.715 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:38:13.394+0000 7f64c8286640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:13.716 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:38:13.394+0000 7f64c8286640 -1 osd.3 766 *** Got signal Terminated *** 2024-09-11T08:38:13.716 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3[64124]: 2024-09-11T08:38:13.394+0000 7f64c8286640 -1 osd.3 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:13.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:13.575Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:13.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:13.576Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:13.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:13 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:13.577Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:16.345 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:16 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:16.078+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:17.343 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:17.052+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:17.343 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:17 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:17.154+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:18.343 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:18.003+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:18.344 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:18.148+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:18.989 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:18.676+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:19.002 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:18 smithi173 podman[151599]: 2024-09-11 08:38:18.746937932 +0000 UTC m=+5.460312252 container died 6eeb47d12c4f3f8702c474a28a072bf5ed3374043bff5a7f039675b16b1a3f06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:19.344 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:18.989+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:19.344 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:19.142+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:19.368 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151599]: 2024-09-11 08:38:19.092446383 +0000 UTC m=+5.805820711 container cleanup 6eeb47d12c4f3f8702c474a28a072bf5ed3374043bff5a7f039675b16b1a3f06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T08:38:19.368 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 bash[151599]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3 2024-09-11T08:38:19.711 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151618]: 2024-09-11 08:38:19.368712903 +0000 UTC m=+0.624995635 container remove 6eeb47d12c4f3f8702c474a28a072bf5ed3374043bff5a7f039675b16b1a3f06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T08:38:19.965 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151713]: 2024-09-11 08:38:19.614542182 +0000 UTC m=+0.015486392 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:19.966 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151713]: 2024-09-11 08:38:19.719452296 +0000 UTC m=+0.120396499 container create 601fd3259c69260f31f52cf7851b583f11f780daf7a23e899abc1610da4bdb3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=) 2024-09-11T08:38:19.966 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151713]: 2024-09-11 08:38:19.930369899 +0000 UTC m=+0.331314099 container init 601fd3259c69260f31f52cf7851b583f11f780daf7a23e899abc1610da4bdb3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T08:38:19.966 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:19 smithi173 podman[151713]: 2024-09-11 08:38:19.935172284 +0000 UTC m=+0.336116487 container start 601fd3259c69260f31f52cf7851b583f11f780daf7a23e899abc1610da4bdb3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:38:19.988 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:19.656+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:20.289 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:19 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:19.987+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:20.289 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:20 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:20.180+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:20.384 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:20 smithi173 podman[151713]: 2024-09-11 08:38:20.005378872 +0000 UTC m=+0.406323094 container attach 601fd3259c69260f31f52cf7851b583f11f780daf7a23e899abc1610da4bdb3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:38:20.384 INFO:journalctl@ceph.osd.3.smithi173.stdout:Sep 11 08:38:20 smithi173 podman[151713]: 2024-09-11 08:38:20.120423336 +0000 UTC m=+0.521367536 container died 601fd3259c69260f31f52cf7851b583f11f780daf7a23e899abc1610da4bdb3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:38:20.384 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:20 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:20.148Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:20.384 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:20 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:20.149Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:20.385 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:20 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:20.149Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:20.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:20 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:20.289+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:20.725 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T08:38:20.763 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:20.763 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T08:38:20.763 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T08:38:20.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.4 2024-09-11T08:38:20.989 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:20 smithi175 systemd[1]: Stopping Ceph osd.4 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:20.990 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:20 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:20.699+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:21.301 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:20 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:20.989+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:21.301 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:21.081+0000 7fbace828640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:21.301 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:21.081+0000 7fbace828640 -1 osd.4 766 *** Got signal Terminated *** 2024-09-11T08:38:21.302 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:21.081+0000 7fbace828640 -1 osd.4 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:21.302 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:21.230+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:21.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:21.301+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:22.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:21.944+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:22.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:21 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:21.694+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:22.593 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:22 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:22.230+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:22.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:22 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:22.311+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:23.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:22 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:22.945+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:23.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:22 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:22.731+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:23.593 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:23 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:23.269+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:23.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:23 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:23.342+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:23.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:23 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:23.576Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:23.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:23 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:23.577Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:23.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:23 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:23.578Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:24.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:23 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:23.752+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:24.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:23 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:23.931+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:24.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:23 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:23.931+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:24.593 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:24.226+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:24.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:24.365+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:25.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:24.924+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:25.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:24.924+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:25.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:24.718+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:25.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:24 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:24.718+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:25.593 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4[38143]: 2024-09-11T08:38:25.194+0000 7fbacbe42640 -1 osd.4 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:54.670343+0000 front 2024-09-11T08:37:54.670397+0000 (oldest deadline 2024-09-11T08:38:16.970270+0000) 2024-09-11T08:38:25.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:25.349+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:25.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:25.349+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:26.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:25.880+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:26.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:25.880+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:26.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:25.764+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:26.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:25 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:25.764+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:26.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:26.315+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:26.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:26.315+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:26.594 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:26 smithi175 podman[71866]: 2024-09-11 08:38:26.519172537 +0000 UTC m=+5.556631374 container died 7b652d337464034fe6451e29944d0c45fbdc9defdd8c2340b6ffad3d3df04761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T08:38:27.094 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:26 smithi175 podman[71866]: 2024-09-11 08:38:26.871105106 +0000 UTC m=+5.908563931 container cleanup 7b652d337464034fe6451e29944d0c45fbdc9defdd8c2340b6ffad3d3df04761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T08:38:27.094 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:26 smithi175 bash[71866]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4 2024-09-11T08:38:27.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:26.852+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:27.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:26.852+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:27.095 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:26.793+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:27.095 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:26 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:26.793+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:27.363 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71889]: 2024-09-11 08:38:27.148040653 +0000 UTC m=+0.620131926 container remove 7b652d337464034fe6451e29944d0c45fbdc9defdd8c2340b6ffad3d3df04761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:38:27.717 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:27.363+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:27.718 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:27.363+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:27.718 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.490937061 +0000 UTC m=+0.109856715 container create d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T08:38:27.718 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.397023673 +0000 UTC m=+0.015943341 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:27.718 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.718452242 +0000 UTC m=+0.337371907 container init d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T08:38:28.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:27.806+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:28.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:27.806+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:28.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:27.799+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:28.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:27 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:27.799+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:28.094 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.72335145 +0000 UTC m=+0.342271106 container start d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T08:38:28.094 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.835116633 +0000 UTC m=+0.454036300 container attach d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T08:38:28.094 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:27 smithi175 podman[71981]: 2024-09-11 08:38:27.895691775 +0000 UTC m=+0.514611430 container died d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T08:38:28.446 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:28.345+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:28.446 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:28.345+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:28.446 INFO:journalctl@ceph.osd.4.smithi175.stdout:Sep 11 08:38:28 smithi175 podman[72024]: 2024-09-11 08:38:28.430412115 +0000 UTC m=+0.529293391 container remove d2388a9006ebe493b1c1a1bcaf8da2cb7052b816111e9d77259691ba526e88f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-11T08:38:28.451 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T08:38:28.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:28.491 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T08:38:28.491 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T08:38:28.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.5 2024-09-11T08:38:28.712 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 systemd[1]: Stopping Ceph osd.5 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:29.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:28.776+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:29.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:28.776+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:29.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:28.843+0000 7f5bcb3d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:29.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:28.843+0000 7f5bcb3d4640 -1 osd.5 766 *** Got signal Terminated *** 2024-09-11T08:38:29.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:28.843+0000 7f5bcb3d4640 -1 osd.5 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:29.095 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:28.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:29.095 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:28 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:28.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:29.678 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:29.348+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:29.678 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:29.348+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:30.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:29.810+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:30.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:29.810+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:30.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:29.808+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:30.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:29 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:29.808+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:30.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:30.150Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:30.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:30.150Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:30.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:30 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:30.151Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:30.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:30.305+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:30.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:30.305+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:31.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:30.829+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:31.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:30.829+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:31.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:30.802+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:31.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:30 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:30.802+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:31.829 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:31.350+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:31.829 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:31.350+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:32.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:31.833+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:32.094 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:31.833+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:32.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:31.829+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:32.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:31 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:31.829+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:32.815 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:32.391+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:32.815 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:32.391+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:33.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:32.816+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.440685+0000 front 2024-09-11T08:37:52.440653+0000 (oldest deadline 2024-09-11T08:38:15.340423+0000) 2024-09-11T08:38:33.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5[44105]: 2024-09-11T08:38:32.816+0000 7f5bc79ec640 -1 osd.5 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.241363+0000 front 2024-09-11T08:37:58.241420+0000 (oldest deadline 2024-09-11T08:38:23.541488+0000) 2024-09-11T08:38:33.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:32.815+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:33.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:32 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:32.815+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:33.795 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:33.359+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:33.796 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:33.359+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:33.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:33.577Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:33.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:33.578Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:33.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:33 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:33.578Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:34.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:33.796+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:34.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:33 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:33.796+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:34.691 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:34 smithi175 podman[72109]: 2024-09-11 08:38:34.382985846 +0000 UTC m=+5.665524979 container died eb3f74f9b2bac15ae7908520ee2077b02a2c4e8a45e1ca406e3c92398a0544ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T08:38:34.691 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:34.408+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:34.691 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:34.408+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:34.984 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:34 smithi175 podman[72109]: 2024-09-11 08:38:34.807658498 +0000 UTC m=+6.090197631 container cleanup eb3f74f9b2bac15ae7908520ee2077b02a2c4e8a45e1ca406e3c92398a0544ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T08:38:34.984 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:34 smithi175 bash[72109]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5 2024-09-11T08:38:34.985 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:34.761+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:34.985 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:34.761+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:34.985 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:34 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:34.761+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:35.343 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:34 smithi175 podman[72140]: 2024-09-11 08:38:34.984913025 +0000 UTC m=+0.598271345 container remove eb3f74f9b2bac15ae7908520ee2077b02a2c4e8a45e1ca406e3c92398a0544ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:38:35.712 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:35.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:35.712 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:35.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:35.712 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:35.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:35.713 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.419158121 +0000 UTC m=+0.105632838 container create a04327d6b9e164d366638af0c50a39084996d4f8fb7f4df71f19b358ec2b5663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T08:38:35.713 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.329651268 +0000 UTC m=+0.016125989 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:35.713 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.604896088 +0000 UTC m=+0.291370806 container init a04327d6b9e164d366638af0c50a39084996d4f8fb7f4df71f19b358ec2b5663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T08:38:35.713 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.609953573 +0000 UTC m=+0.296428294 container start a04327d6b9e164d366638af0c50a39084996d4f8fb7f4df71f19b358ec2b5663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T08:38:35.713 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.713136175 +0000 UTC m=+0.399610915 container attach a04327d6b9e164d366638af0c50a39084996d4f8fb7f4df71f19b358ec2b5663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:36.093 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 11 08:38:35 smithi175 podman[72235]: 2024-09-11 08:38:35.788459061 +0000 UTC m=+0.474933782 container died a04327d6b9e164d366638af0c50a39084996d4f8fb7f4df71f19b358ec2b5663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:36.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:35.797+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:36.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:35.797+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:36.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:35 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:35.797+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:36.390 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T08:38:36.428 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:36.429 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T08:38:36.429 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T08:38:36.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.6 2024-09-11T08:38:36.771 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:36.771 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:36.771 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.390+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:36.771 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 systemd[1]: Stopping Ceph osd.6 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:36.772 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.771+0000 7f15e1ba7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:36.772 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.771+0000 7f15e1ba7640 -1 osd.6 766 *** Got signal Terminated *** 2024-09-11T08:38:36.772 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:36.771+0000 7f15e1ba7640 -1 osd.6 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:37.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:36.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:37.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:36.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:37.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:36 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:36.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:37.808 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:37.410+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:37.808 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:37.410+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:37.808 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:37.410+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:38.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:37.808+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:38.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:37.808+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:38.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:37 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:37.808+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:38.845 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:38.397+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:38.846 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:38.397+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:38.846 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:38.397+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:39.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:38.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:39.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:38.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:39.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:38 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:38.844+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:39.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:39.375+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:39.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:39.375+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:39.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:39.375+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:40.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:39.876+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:40.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:39.876+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:40.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:39.876+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:40.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:39 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:39.876+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:40.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:40 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:40.150Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:40.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:40 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:40.151Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:40.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:40 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:40.151Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:40.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:40.329+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:40.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:40.329+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:40.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:40.329+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:41.283 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:40.918+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:41.283 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:40.918+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:41.283 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:40.918+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:41.283 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:40 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:40.918+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:41.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:41.282+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:53.834296+0000 front 2024-09-11T08:37:53.834411+0000 (oldest deadline 2024-09-11T08:38:19.734234+0000) 2024-09-11T08:38:41.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:41.282+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:59.734818+0000 front 2024-09-11T08:37:59.734846+0000 (oldest deadline 2024-09-11T08:38:24.434793+0000) 2024-09-11T08:38:41.593 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:41.282+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.335793+0000 front 2024-09-11T08:38:10.335929+0000 (oldest deadline 2024-09-11T08:38:35.035948+0000) 2024-09-11T08:38:41.594 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6[50182]: 2024-09-11T08:38:41.282+0000 7f15df1c1640 -1 osd.6 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:15.036344+0000 front 2024-09-11T08:38:15.036392+0000 (oldest deadline 2024-09-11T08:38:40.936250+0000) 2024-09-11T08:38:42.343 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:42 smithi175 podman[72364]: 2024-09-11 08:38:42.192523739 +0000 UTC m=+5.541822939 container died e57e1b50b83da820cbda44a8d3991608786c947cc4f8b3cd910cf8bc6c08a67f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T08:38:42.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:41.948+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:42.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:41.948+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:42.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:41.948+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:42.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:41 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:41.948+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:42.843 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:42 smithi175 podman[72364]: 2024-09-11 08:38:42.543699126 +0000 UTC m=+5.892998319 container cleanup e57e1b50b83da820cbda44a8d3991608786c947cc4f8b3cd910cf8bc6c08a67f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T08:38:42.843 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:42 smithi175 bash[72364]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6 2024-09-11T08:38:43.153 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:42 smithi175 podman[72388]: 2024-09-11 08:38:42.844818351 +0000 UTC m=+0.648766773 container remove e57e1b50b83da820cbda44a8d3991608786c947cc4f8b3cd910cf8bc6c08a67f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-11T08:38:43.153 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:42 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:42.910+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:43.153 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:42 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:42.910+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:43.153 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:42 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:42.910+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:43.153 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:42 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:42.910+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:43.481 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.056617412 +0000 UTC m=+0.015945849 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:43.481 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.173181857 +0000 UTC m=+0.132510340 container create 8cc2484fe15e356c47d476affa0239a04f47704940e8ff230b54a38a399405bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T08:38:43.481 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.398694017 +0000 UTC m=+0.358022442 container init 8cc2484fe15e356c47d476affa0239a04f47704940e8ff230b54a38a399405bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T08:38:43.482 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.403455159 +0000 UTC m=+0.362783585 container start 8cc2484fe15e356c47d476affa0239a04f47704940e8ff230b54a38a399405bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:43.482 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.482055025 +0000 UTC m=+0.441383450 container attach 8cc2484fe15e356c47d476affa0239a04f47704940e8ff230b54a38a399405bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T08:38:43.843 INFO:journalctl@ceph.osd.6.smithi175.stdout:Sep 11 08:38:43 smithi175 podman[72482]: 2024-09-11 08:38:43.580087061 +0000 UTC m=+0.539415496 container died 8cc2484fe15e356c47d476affa0239a04f47704940e8ff230b54a38a399405bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T08:38:43.965 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:43.578Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:43.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:43.578Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:43.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:43 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:43.579Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:44.127 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:43.944+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:44.127 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:43.944+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:44.127 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:43.944+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:44.127 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:43 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:43.944+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:44.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T08:38:44.188 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:44.189 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T08:38:44.189 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T08:38:44.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.7 2024-09-11T08:38:44.533 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 systemd[1]: Stopping Ceph osd.7 for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:44.843 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.532+0000 7f214c02b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:44.843 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.532+0000 7f214c02b640 -1 osd.7 766 *** Got signal Terminated *** 2024-09-11T08:38:44.843 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.532+0000 7f214c02b640 -1 osd.7 766 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T08:38:45.343 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.901+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:45.343 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.901+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:45.343 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.901+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:45.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:44 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:44.901+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:46.343 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:45.871+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:46.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:45.871+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:46.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:45.871+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:46.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:45 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:45.871+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:47.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:46.855+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:47.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:46.855+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:47.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:46.855+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:47.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:46 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:46.855+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:48.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:47 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:47.841+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:48.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:47 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:47.841+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:48.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:47 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:47.841+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:48.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:47 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:47.841+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:49.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:48 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:48.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6806 osd.0 since back 2024-09-11T08:37:52.638198+0000 front 2024-09-11T08:37:52.638181+0000 (oldest deadline 2024-09-11T08:38:18.538116+0000) 2024-09-11T08:38:49.093 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:48 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:48.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6814 osd.1 since back 2024-09-11T08:37:58.538618+0000 front 2024-09-11T08:37:58.538600+0000 (oldest deadline 2024-09-11T08:38:24.438496+0000) 2024-09-11T08:38:49.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:48 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:48.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6822 osd.2 since back 2024-09-11T08:38:10.339300+0000 front 2024-09-11T08:38:10.339157+0000 (oldest deadline 2024-09-11T08:38:33.839239+0000) 2024-09-11T08:38:49.094 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:48 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7[56417]: 2024-09-11T08:38:48.837+0000 7f2149e46640 -1 osd.7 766 heartbeat_check: no reply from 172.21.15.173:6830 osd.3 since back 2024-09-11T08:38:13.839842+0000 front 2024-09-11T08:38:13.839808+0000 (oldest deadline 2024-09-11T08:38:39.739651+0000) 2024-09-11T08:38:50.344 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:50 smithi175 podman[72611]: 2024-09-11 08:38:50.026455068 +0000 UTC m=+5.614000565 container died 86484102d04ac244d8376d47d39b7971be5a4bbe4f8988099ab99a20cd557ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T08:38:50.465 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:50.151Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:50.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:50.152Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:50.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:50 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:50.152Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:50.773 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:50 smithi175 podman[72611]: 2024-09-11 08:38:50.497769412 +0000 UTC m=+6.085314909 container cleanup 86484102d04ac244d8376d47d39b7971be5a4bbe4f8988099ab99a20cd557ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True) 2024-09-11T08:38:50.773 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:50 smithi175 bash[72611]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7 2024-09-11T08:38:51.079 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:50 smithi175 podman[72635]: 2024-09-11 08:38:50.774057687 +0000 UTC m=+0.748014235 container remove 86484102d04ac244d8376d47d39b7971be5a4bbe4f8988099ab99a20cd557ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T08:38:51.345 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:50.982487679 +0000 UTC m=+0.015725089 image pull 4a918172a49766385959227c53e75e2c302e923539324792cb5bee6cad0b2f2b quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40 2024-09-11T08:38:51.345 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:51.082968579 +0000 UTC m=+0.116205982 container create fd9b5c54b125edb387500a2cb4ea6ce799284152f9fb1ea431e9b754aa42c016 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T08:38:51.345 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:51.285442131 +0000 UTC m=+0.318679534 container init fd9b5c54b125edb387500a2cb4ea6ce799284152f9fb1ea431e9b754aa42c016 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T08:38:51.345 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:51.289986376 +0000 UTC m=+0.323223779 container start fd9b5c54b125edb387500a2cb4ea6ce799284152f9fb1ea431e9b754aa42c016 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T08:38:51.762 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:51.368496343 +0000 UTC m=+0.401733765 container attach fd9b5c54b125edb387500a2cb4ea6ce799284152f9fb1ea431e9b754aa42c016 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:38:51.762 INFO:journalctl@ceph.osd.7.smithi175.stdout:Sep 11 08:38:51 smithi175 podman[72728]: 2024-09-11 08:38:51.468246113 +0000 UTC m=+0.501483517 container died fd9b5c54b125edb387500a2cb4ea6ce799284152f9fb1ea431e9b754aa42c016 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T08:38:52.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T08:38:52.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:38:52.148 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T08:38:52.148 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-11T08:38:52.148 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@rgw.foo.a 2024-09-11T08:38:52.436 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:38:52 smithi173 systemd[1]: Stopping Ceph rgw.foo.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:38:52.716 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:38:52 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a[69532]: 2024-09-11T08:38:52.435+0000 7fa363fff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T08:38:52.716 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:38:52 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a[69532]: 2024-09-11T08:38:52.435+0000 7fa374b637c0 -1 shutting down 2024-09-11T08:38:53.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:53 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:53.579Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:38:53.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:53 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:53.579Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:38:53.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:38:53 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:38:53.580Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:39:00.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:00.152Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:39:00.466 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:00.153Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:39:00.467 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:00 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:00.153Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:39:01.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:01 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:01.625Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:39:01.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:01 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:01.626Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:39:02.716 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:39:02 smithi173 bash[151863]: time="2024-09-11T08:39:02Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-09-11T08:39:02.716 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:39:02 smithi173 podman[151863]: 2024-09-11 08:39:02.46297181 +0000 UTC m=+10.124714526 container died 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T08:39:03.008 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:39:02 smithi173 podman[151863]: 2024-09-11 08:39:02.791187906 +0000 UTC m=+10.452930616 container cleanup 12b34fb46112420e5cc694e0a3f0cbee4c119f892bdee2454eda59676ab6613f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828) 2024-09-11T08:39:03.008 INFO:journalctl@ceph.rgw.foo.a.smithi173.stdout:Sep 11 08:39:02 smithi173 bash[151863]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-rgw-foo-a 2024-09-11T08:39:03.222 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@rgw.foo.a.service' 2024-09-11T08:39:03.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:39:03.259 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-11T08:39:03.259 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-11T08:39:03.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4492cbfa-7015-11ef-bcea-c7b262605968@prometheus.a 2024-09-11T08:39:03.575 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 systemd[1]: Stopping Ceph prometheus.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.575Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-11T08:39:03.844 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.576Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a[67115]: ts=2024-09-11T08:39:03.577Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-11T08:39:03.845 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 podman[72854]: 2024-09-11 08:39:03.586324659 +0000 UTC m=+0.122735215 container died 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:03.965 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:03.580Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:39:03.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:03.580Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi173.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.173:8443: connect: connection refused" 2024-09-11T08:39:03.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:03 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:03.581Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi175.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.175:8443: connect: connection refused" 2024-09-11T08:39:04.224 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 podman[72854]: 2024-09-11 08:39:03.948690779 +0000 UTC m=+0.485101324 container cleanup 0ad6edf35f3bdb93877e055661934c94453adde44f15b623253aba74228eac67 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:04.224 INFO:journalctl@ceph.prometheus.a.smithi175.stdout:Sep 11 08:39:03 smithi175 bash[72854]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-prometheus-a 2024-09-11T08:39:04.390 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4492cbfa-7015-11ef-bcea-c7b262605968@prometheus.a.service' 2024-09-11T08:39:04.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T08:39:04.427 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-11T08:39:04.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T08:39:06.407 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:06 smithi173 systemd[1]: Stopping Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:06.705 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:06 smithi173 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a[78941]: ts=2024-09-11T08:39:06.407Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-11T08:39:06.705 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:06 smithi173 podman[152321]: 2024-09-11 08:39:06.44842026 +0000 UTC m=+0.171900716 container died 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:06.965 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:06 smithi173 podman[152321]: 2024-09-11 08:39:06.805083261 +0000 UTC m=+0.528563716 container cleanup 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:06.966 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:06 smithi173 bash[152321]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a 2024-09-11T08:39:07.361 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:07 smithi173 podman[152340]: 2024-09-11 08:39:07.072913051 +0000 UTC m=+0.621417976 container remove 951d1521f6570c0b8bd434884a0e4e40b4e027b1c5c8d60af896ab33aaa58e19 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:07.361 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:07 smithi173 podman[152340]: 2024-09-11 08:39:07.156752705 +0000 UTC m=+0.705257630 volume remove f4447b048f63b61127bc5d76ddc1c2537030a67cce2d61fabcefcf6b4c1e1321 2024-09-11T08:39:07.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:07 smithi173 systemd[1]: Stopping Ceph node-exporter.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:07.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:07 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-11T08:39:07.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:07 smithi173 systemd[1]: Stopped Ceph alertmanager.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:39:07.716 INFO:journalctl@ceph.alertmanager.a.smithi173.stdout:Sep 11 08:39:07 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@alertmanager.a.service: Consumed 1.859s CPU time. 2024-09-11T08:39:08.093 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:07 smithi173 podman[152452]: 2024-09-11 08:39:07.830778224 +0000 UTC m=+0.132293666 container died 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:08.434 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 podman[152452]: 2024-09-11 08:39:08.184566509 +0000 UTC m=+0.486081939 container cleanup 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:08.435 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 bash[152452]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a 2024-09-11T08:39:08.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 podman[152470]: 2024-09-11 08:39:08.435637899 +0000 UTC m=+0.608774086 container remove 6497020fe8008f918720e8a1d4ed5b7ba0bb0a603633f39bad1b7ac444332316 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-11T08:39:08.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-11T08:39:08.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-11T08:39:08.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 systemd[1]: Stopped Ceph node-exporter.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:39:08.716 INFO:journalctl@ceph.node-exporter.a.smithi173.stdout:Sep 11 08:39:08 smithi173 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.a.service: Consumed 3.654s CPU time. 2024-09-11T08:39:09.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T08:39:10.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:10 smithi175 systemd[1]: Stopping Ceph iscsi.iscsi.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:10.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:10 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a[61888]: debug Shutdown received 2024-09-11T08:39:19.343 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:18 smithi175 ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a[65703]: logger=cleanup t=2024-09-11T08:39:18.998482719Z level=info msg="Completed cleanup jobs" duration=11.96374ms 2024-09-11T08:39:21.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:20 smithi175 bash[73254]: time="2024-09-11T08:39:20Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-09-11T08:39:21.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:20 smithi175 podman[73254]: 2024-09-11 08:39:20.764351148 +0000 UTC m=+10.120760772 container died aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T08:39:21.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:21 smithi175 podman[73254]: 2024-09-11 08:39:21.284302692 +0000 UTC m=+10.640712321 container cleanup aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T08:39:21.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:21 smithi175 bash[73254]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a 2024-09-11T08:39:21.816 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:21 smithi175 podman[73279]: 2024-09-11 08:39:21.469076541 +0000 UTC m=+0.704479872 container remove aac3ced51cb3e0ea3ac5a4617ac595dc1735725c2afe2aa138089613775b8d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T08:39:21.817 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:21 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-11T08:39:22.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:21 smithi175 podman[73328]: 2024-09-11 08:39:21.817668816 +0000 UTC m=+0.116364802 container died fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T08:39:22.515 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 podman[73328]: 2024-09-11 08:39:22.129649644 +0000 UTC m=+0.428345628 container cleanup fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T08:39:22.515 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 bash[73328]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu 2024-09-11T08:39:22.515 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-11T08:39:22.516 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service: Unit process 61728 (conmon) remains running after unit stopped. 2024-09-11T08:39:22.516 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service: Unit process 73346 (podman) remains running after unit stopped. 2024-09-11T08:39:22.516 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: Stopped Ceph iscsi.iscsi.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:39:22.516 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@iscsi.iscsi.a.service: Consumed 3.247s CPU time. 2024-09-11T08:39:22.516 INFO:journalctl@ceph.iscsi.iscsi.a.smithi175.stdout:Sep 11 08:39:22 smithi175 podman[73346]: 2024-09-11 08:39:22.355839068 +0000 UTC m=+0.534383055 container remove fb15a26e0420045554dacdfc1c2d6d207aa9419a5ab4e6cea5272f67d1571fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef9c65e2a6ea9377a732e309273ea235301c4d330f09e2972aeebc38173d3e40, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-iscsi-iscsi-a-tcmu, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-quincy-2024-09-10-2008-quincy-d0e6828, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T08:39:22.771 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:22 smithi175 systemd[1]: Stopping Ceph grafana.a for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:23.025 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:22 smithi175 podman[73469]: 2024-09-11 08:39:22.772136194 +0000 UTC m=+0.111548324 container died 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a, io.openshift.tags=base rhel8, release=239.1651231664, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.buildah.version=1.32.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=ubi8-container, description=Ceph Grafana Container, vcs-type=git, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , distribution-scope=public, version=8.5, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, build-date=2022-04-29T11:48:11.055897, architecture=x86_64) 2024-09-11T08:39:23.292 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 podman[73469]: 2024-09-11 08:39:23.100150317 +0000 UTC m=+0.439562439 container cleanup 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a, distribution-scope=public, io.buildah.version=1.32.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8.5, io.openshift.tags=base rhel8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=239.1651231664, name=ubi8, vendor=Red Hat, Inc., build-date=2022-04-29T11:48:11.055897, architecture=x86_64, com.redhat.component=ubi8-container, io.openshift.expose-services=, io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, description=Ceph Grafana Container, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com) 2024-09-11T08:39:23.293 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 bash[73469]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a 2024-09-11T08:39:23.593 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 podman[73486]: 2024-09-11 08:39:23.293024266 +0000 UTC m=+0.523400115 container remove 2e95d13872ed6860422695010010d3b32946e71e2c38908237f2aa97ce4fdecf (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-grafana-a, com.redhat.component=ubi8-container, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, build-date=2022-04-29T11:48:11.055897, io.openshift.expose-services=, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, architecture=x86_64, release=239.1651231664, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., io.buildah.version=1.32.0, vcs-type=git, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56) 2024-09-11T08:39:23.593 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-09-11T08:39:23.594 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@grafana.a.service: Failed with result 'exit-code'. 2024-09-11T08:39:23.594 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 systemd[1]: Stopped Ceph grafana.a for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:39:23.594 INFO:journalctl@ceph.grafana.a.smithi175.stdout:Sep 11 08:39:23 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@grafana.a.service: Consumed 11.297s CPU time. 2024-09-11T08:39:24.093 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:23 smithi175 systemd[1]: Stopping Ceph node-exporter.b for 4492cbfa-7015-11ef-bcea-c7b262605968... 2024-09-11T08:39:24.093 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:23 smithi175 podman[73603]: 2024-09-11 08:39:23.933552874 +0000 UTC m=+0.109102318 container died 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:39:24.454 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 podman[73603]: 2024-09-11 08:39:24.26220675 +0000 UTC m=+0.437756184 container cleanup 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:39:24.454 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 bash[73603]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b 2024-09-11T08:39:24.821 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 podman[73620]: 2024-09-11 08:39:24.454958775 +0000 UTC m=+0.525370130 container remove 025520f9547abd2ef653ec29f4f21c1a12c8d3c5eae34312244bee29a85e8e90 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-4492cbfa-7015-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-11T08:39:24.821 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-11T08:39:24.821 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-11T08:39:24.821 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 systemd[1]: Stopped Ceph node-exporter.b for 4492cbfa-7015-11ef-bcea-c7b262605968. 2024-09-11T08:39:24.821 INFO:journalctl@ceph.node-exporter.b.smithi175.stdout:Sep 11 08:39:24 smithi175 systemd[1]: ceph-4492cbfa-7015-11ef-bcea-c7b262605968@node-exporter.b.service: Consumed 3.554s CPU time. 2024-09-11T08:39:25.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:39:25.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T08:39:25.376 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T08:39:25.378 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi173/crash 2024-09-11T08:39:25.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash -- . 2024-09-11T08:39:25.452 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T08:39:25.453 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-09-11T08:39:25.455 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi175/crash 2024-09-11T08:39:25.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash -- . 2024-09-11T08:39:25.508 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T08:39:25.509 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-09-11T08:39:25.510 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T08:39:25.511 DEBUG:teuthology.orchestra.run.smithi173:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-11T08:39:25.546 INFO:teuthology.orchestra.run.smithi173.stderr:grep: /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph.log: No such file or directory 2024-09-11T08:39:25.546 INFO:tasks.cephadm:Compressing logs... 2024-09-11T08:39:25.547 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T08:39:25.589 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T08:39:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T08:39:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T08:39:25.618 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T08:39:25.618 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-client.rgw.foo.a.log 2024-09-11T08:39:25.624 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/tcmu-runner.log 2024-09-11T08:39:25.625 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-09-11T08:39:25.625 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T08:39:25.625 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T08:39:25.625 INFO:teuthology.orchestra.run.smithi175.stderr: 63.7% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/tcmu-runner.log.gz 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T08:39:25.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T08:39:25.627 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.b.log: /var/log/ceph/cephadm.log: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T08:39:25.628 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.2.log: /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T08:39:25.628 INFO:teuthology.orchestra.run.smithi175.stderr: 92.1% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T08:39:25.629 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T08:39:25.630 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-client.rgw.foo.a.log: 91.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T08:39:25.637 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T08:39:25.657 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T08:39:25.749 INFO:teuthology.orchestra.run.smithi173.stderr: 94.2% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-client.rgw.foo.a.log.gz 2024-09-11T08:39:26.054 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T08:39:26.459 INFO:teuthology.orchestra.run.smithi175.stderr: 92.8% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T08:39:26.518 INFO:teuthology.orchestra.run.smithi173.stderr: 92.9% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T08:39:28.101 INFO:teuthology.orchestra.run.smithi173.stderr: 91.9% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T08:39:30.674 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T08:39:31.322 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T08:39:31.548 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T08:39:31.565 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T08:39:31.659 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T08:39:31.662 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-11T08:39:31.662 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m6.057s 2024-09-11T08:39:31.662 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m22.861s 2024-09-11T08:39:31.662 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.826s 2024-09-11T08:39:31.668 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T08:39:31.740 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T08:39:32.387 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/4492cbfa-7015-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T08:39:32.389 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-11T08:39:32.390 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m6.787s 2024-09-11T08:39:32.390 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m27.473s 2024-09-11T08:39:32.390 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.983s 2024-09-11T08:39:32.390 INFO:tasks.cephadm:Archiving logs... 2024-09-11T08:39:32.390 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi173/log 2024-09-11T08:39:32.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T08:39:35.899 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi175/log 2024-09-11T08:39:35.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T08:39:39.137 INFO:tasks.cephadm:Removing cluster... 2024-09-11T08:39:39.137 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 --force 2024-09-11T08:39:39.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4492cbfa-7015-11ef-bcea-c7b262605968 --force 2024-09-11T08:39:40.209 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T08:39:40.209 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T08:39:40.225 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T08:39:40.241 INFO:tasks.cephadm:Teardown complete 2024-09-11T08:39:40.241 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T08:39:40.251 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T08:39:40.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T08:39:40.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T08:39:40.349 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T08:39:40.357 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T08:39:40.357 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T08:39:40.360 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T08:39:40.372 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-11T08:39:40.374 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-11T08:39:40.376 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T08:39:40.376 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-11T08:39:40.377 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -1747us[-1753us] +/- 49ms 2024-09-11T08:39:40.377 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +1620us[+1614us] +/- 71ms 2024-09-11T08:39:40.377 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +974us[ +968us] +/- 86ms 2024-09-11T08:39:40.377 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:39:40.378 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T08:39:40.379 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-11T08:39:40.379 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 -1739us[-1740us] +/- 49ms 2024-09-11T08:39:40.379 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +1641us[+1640us] +/- 71ms 2024-09-11T08:39:40.379 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +1004us[+1003us] +/- 86ms 2024-09-11T08:39:40.379 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T08:39:40.379 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T08:39:40.410 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T08:39:40.411 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T08:39:40.420 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T08:39:40.496 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T08:39:40.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T08:39:40.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:39:40.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T08:39:40.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:39:40.626 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T08:39:40.634 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T08:39:40.644 INFO:teuthology.task.internal:Duration was 2143.493593 seconds 2024-09-11T08:39:40.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T08:39:40.655 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T08:39:40.655 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T08:39:40.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T08:39:40.693 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T08:39:40.704 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T08:39:41.132 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T08:39:41.132 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-11T08:39:41.133 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T08:39:41.153 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T08:39:41.153 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T08:39:41.193 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T08:39:41.193 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T08:39:41.196 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T08:39:41.260 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T08:39:41.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T08:39:41.263 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T08:39:41.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T08:39:41.708 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T08:39:41.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T08:39:41.732 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T08:39:41.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T08:39:41.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T08:39:41.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T08:39:41.795 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-11T08:39:41.820 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-11T08:39:41.843 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T08:39:41.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:39:41.863 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T08:39:41.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T08:39:41.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T08:39:42.077 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T08:39:42.078 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi173 2024-09-11T08:39:42.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T08:39:42.386 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-11_06:53:43-orch:cephadm-wip-guits-quincy-2024-09-10-2008-quincy-distro-default-smithi/7901261/remote/smithi175 2024-09-11T08:39:42.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T08:39:42.425 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T08:39:42.426 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T08:39:42.428 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T08:39:42.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T08:39:42.484 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T08:39:42.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T08:39:42.492 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T08:39:42.492 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T08:39:42.495 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T08:39:42.507 INFO:teuthology.orchestra.run.smithi173.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 08:39 /home/ubuntu/cephtest 2024-09-11T08:39:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 08:39 /home/ubuntu/cephtest 2024-09-11T08:39:42.533 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T08:39:42.544 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T08:39:42.567 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} duration: 2143.493592977524 flavor: default owner: scheduled_gabrioux@teuthology success: true 2024-09-11T08:39:42.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T08:39:42.646 INFO:teuthology.run:pass